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Preface 



This collection has been a learning experience for the 
editors, both in assembly of papers electronically and 
understanding the varied skills of academics in pro- 
ducing publishable work directly from a word proces- 
sor. As we move towards a time when computers 
allow greater access to cheap publication, it is instruc- 
tive to realize how much staff development work is 
still required for the writer to develop their abilities in 
preparing papers. Maybe one day the story of editing 
this collection will be told. 

Under the constraints of time we have attempted the 
best we could, we hope the combined work of a small 
team of enthusiasts will have caught the errors and 
make interesting reading. 



John Barrett and John Hedberg 
Sydney 

November 1987 
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The Marshall Harris 
keynote address 



It takes a great deal of hard work to establish 
and maintain an organization such as 
ASCILTTE. Many people have devoted a lot 
of energy to the success of our society. 
However, none of this effort or success 
would have been possible were it not for the 
initial work of Marshall Harris. Marshall 
was the driving force behind the first 
CALITE conference. It was he who took the 
untested concept of a tertiary oriented CAL 
conference and brought it to life. Many have 
laboured on our behalf since Marshall led the 
way, but they have had the advantage of the 
knowledge that what they strove for was 
viable. 

In organizing that first conference Marshall 
had no such assurance. ASCILITE has 
emerjed as a society fi„»n his initial input. 

Marshall Harris, the mem jers of ASCILTi £ 
thank you. 
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The address in 1987 was presented by Professor Alan 
Lesgpld and a text of his presentation is included in this 
volume on page seven. 
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Patient simulation using interactive video: 
An application 



Joseph V. Henderson, MD 

Department of Preventive Medicine and Biometrics 
Uniformed Services University of the Health Sciences 



Training military physicians in trauma manage- 
ment is a dilemma in peacetime, since there are 
few opportunities to gain clinical experience 
within the military care system. We decided to 
attempt to use interactive video as a means of 
providing some experience in clinical decision 
making through patient Emulation. Five cases, 
of increasing difficulty, are presented on a single 
videodisc side. The program is implemented on 
a system based on trie IBM PQ and is written in 
the C programming language. The program 
emphasizes clinical realism by providing many 
clinical options at each decision point, and by 
audiovisually depicting combat clinical care in 
very realistic ways. The user interface is flexible 
and, though complex, is relatively easy to use; it 
is supported by a narrated, on line tutorial 

Providing surgical care to combat casual- 
ties is a problem for our armed forces. 
Between wars there are few military 
trauma patients and, consequently, few 
chances for military surgeons to get experi- 
ence in trauma care. During wartime this 
shortage of experienced surgeons will be 
acute, and even conservative casualty pro- 
jections indicate that a physician draft will 
not resolve the shortage. Care of combat 
casualties may suffer, and lives and limbs 
of servicemen may be jeopardized. 

Part of the solution is to free experienced 
surgeons to do surgery, and to permit non- 
surgeon physicians to take care of trauma 
patients before and after they are in the 
operating room. At the early echelons of 
care, close to the battle front, non specialist 
physicians and Hospital Corpsmen are 
already designated to treat patients. At the 
later echelons, such as combat zone field 
and fleet hospitals and hospital ships, our 



plans call for non-surgeon physicians to be 
assigned to resuscitate and stabilize 
trauma patients. Naturally, these physi- 
cians must also get training in trauma 
management, but clinical opportunities for 
this are even less likely than for surgeons' 
training. 

As a partial solution to this problem, we are 
now providing Advanced Trauma Life 
Support (ATLS) training to active duty and 
reserve medical officers. ATLS was devel- 
oped and is administered by the American 
College of Surgeons (American College of 
Surgeons, 1984). Ifs designed for surgeons 
and other physicians, civilian or military, 
who are iikely to care for trauma patients. 
Techniques of surgery are not taught; 
ATLS stresses early management of 
trauma patients: initial resuscitation, stabi- 
lization, and disposition. The course uses a 
combination of lecture, small group discus- 
sion, and practical experience with ani- 
mals, manikins, and volunteers simulating 
injury. Although physicians sometimes 
disagree with some of its recommenda- 
tions, ATLS establishes a standard method 
of managing trauma patients, a standard- 
ized curriculum and content, and stan- 
dards for certifying physicians in trauma 
management. 

Simulation is particularly useful for teach- 
ing and testing the ability of students to 
integrate the facts and rules learned in the 
classroom and make patient management 
decisions In addition to animal and 
anatomic models, and live actors already 
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used in ATLS teaching, computer-aided 
instruction (CAI) could also be used to 
simulate. CAI can instruct in an interactive 
way thatisintrinsically motivating,and the 
pace and content of instruction can be tai- 
lored to the student. Using text and limited 
graphics, conventional CAI can present 
problems in a fairly realistic way. Some 
advantages over animal and human simu- 
lations are decreased cost and presenta- 
tions of uniform content and quality. 

Over the past few years, CAI developed 
have improved the realism of simulations 
by using optical videodisc technology 
(Leveridge, 1981; Abdulla and Henke, 
1984; Woods et al, 1984). High-fidelity 
audiovisual sequences or still frames can 
be quickly accessed, depending on the in- 
structional design and the student's 
choices. Computer-generatedgraphicscan 
be superimposed over the video image. 
When used in medical education, the result 
can be a veiy realistic clinical simulation, 
especially useful when interaction with 
genuine patients is undesirable or impos- 
sible. 

Interactive videodisc (IVD) is likely soon to 
be the preferred method for general and 
specialty board medical examinations. 
Within five years IVD will be the major 
testing medium for Part III of the National 
Board Examinations for physician certifi- 
cation. Recently, the American College of 
Cardiology has endorsed the use of com- 
puter-based IVD instruction for teaching 
and certification in Advanced Cardiac Life 
Support (ACLS) (Abdulla and Henke, 
1984). ATLS has so far made no use of 
Computer-based learning techniques, with 
or without videodisc. 

The Naval Health Sciences Education and 
Training Command is no w using IVD tech- 
nology for medical education to train 
health prof essio \alsateverylevel. Thefirst 
programs were for training Hospital 
Corpsmen in anatomy and physiology, 
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and in management of emergency medical 
conditions. The most recent program, 
developed for the Navy at the Uniformed 
Services University of the Health Sciences, 
teaches ATLS principles to physicians who 
may be responsible for the care of combat 
casualties. 

Hardware 

The student version of the system presently 
uses an IBM PC XT with 640 Kbytes of 
random access memory, a 20 Mbyte hard 
disk and single 360 Kbyte floppy disk 
drives, a 12" Sony RGB monitor (PVM 
1271Q) with light pen, a Pioneer LDV-1000 
laser videodisc, and a genlock graphics 
card with videodisc controller (GL-512/ 
VDC 100, Online Products Corp). The 
courseware authoring version of the sys- 
tem is as above, except that the computer is 
anIBMPC-ATwith20 Mbyte hard disc and 
12 Mbyte floppy, with a monochrome 
monitor for programming use. Systems 
were purchased from Online Products 
Corporation, Germantown, MD. 

The Sony monitor is equipped with a light 
pen, allowing students to enter responses 
without the keyboard. This can ease use of 
the system by less experienced students. 

The laser videodisc unit is capable of ran- 
domly accessing any of 54,000 frames per 
videodisc side, with maximum seek time of 
about three seconds. Single frames such as 
xrays can be shown with adequate resolu- 
tion. Motion sequences can run forward or 
backward, at normal, fast, and slow 
speeds. There are two audio tracks which 
can be included or mixed, for example, to 
include narrated instructions or ambient 
sounds to enhance realism. These features 
are entirely under computer control: the 
student's choice, dictate what he sees and 
hears. 

The GL512 'Genlock' card allows place- 
ment of computer-generated graphicsover 
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the video image. Text or pictures, with or 
without animation, can be used, to empha- 
size, simulate, and produce special video 
effects such as windows and scrolling. The 
card also provides an interface giving the 
PC control over the videodi ^ player. 

Software 

Online Products Corporation provided us 
with IVD a introl routines written in assem- 
bly code- 7 hese tools drive the GL512 inter- 
faces, and can be incorporated into author- 
developed computer programs ritten in 
theCprogramming language (MicrosoftC, 
Version 4,0), to control vhe videodisc and 
computer graphics. A result is computer 
code that is compact and readily main- 
tained, that executes quickly, and that is 
portable to other computer systems. 

Unlike the PILOT authoring language, 
which is designed for educators who need 
not be computer professionals, C is a com- 
puter language designed for professional 
programmers: it requires detailed Knowl- 
edge simply to understand a program list- 
ing. For this reason, we have developed an 
authoring environment written inC which 
allows a course author to write and display 
content, designate correct answers and 
their sequence, design screens and menus, 
and to control the video and audio output 
of the videodisc player. In this way new 
programs can be developed, and old ones 
updated, with little or no intervention by a 
programmer. 

Instructional objectives 

Our program is designed to implement 
ATLS goals suitable to the interactive video 
medium. In working through the simu- 
lated cases, the physician user will: 

1. Demonstrate an understanding of the 
concepts and principles of primary and 
secondary patient assessment. 

2. Showthathecanestablishmanagement 
priorities in a trauma case. 



3. Indicate an understanding of the pri- 
mary and secondary management nec- 
essary within the first hour of emer- 
gency care for acute life threatening 
emergencies. 

4. Demonstrate an understanding of 
proper disposition of stabilized trauma 
patients. 

Program description 

The program stresses realism: military, 
clinical, and interpersonal. The inherent 
drama of wartime medicine and casualty 
care is exploited to involve the learner, and 
draw him in a personal way into the situ- 
ations presented. As in real life, the student 
cannot predict in advance what case he will 
see, even if he has used the program before. 
Also, doing the same thing in apparently 
similar situations will not always have the 
intended.result Finally, time is an impor- 
tant element, indicated by a clock dis- 
played on the screen. 

The student is presented five different 
cases with various combinations of airway, 
breathing, circulation, and neurological 
problems. Successive cases increase in 
complexity and difficulty, and they build 
on the experience of previous cases. The 
last case is a kind of final exam, having 
several p^blems. 

At the usual 30 frames per second, a single 
videodisc side allows only 30 minutes, of 
motion video. Disc economy requires that 
cases having common attributes share 
audiovisual sequences where possible. 
This means that care be taken with action, 
dialogue, setting, makeup, and props, to 
ensme continuity. 

The student interacts with the program by 
selecting from menus either using light pen 
or, since allchoices have unique first letters, 
with the keyboard. Clinical realism re- 
quires that the learner be able to select from 
a very wide number of choices at each 
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decision point; it would be artificial to pres- 
ent a complex situation and provide only a 
few choices. The menu system provides 80 
to 90 choices, each of which results in a 
more-or-less tailored feedback message 
indicating the correctness (within the con- 
text of ATLS) of the choice, a reason, and - 
if incorrect - a suggestion toward the cor- 
rect choice. The menu also conveys con- 
tent, since it is structured in the same way 
ATLS structures management of trauma; it 
forces the learner to think in ATLS terms in 
order to do the simulation. A final feature 
is 'windowing' and 'tiling' of menus: 
menus in a hierarchy are superimposed on 
the screen, permitting the tearner to keep 
his orientation to that hierarchy. 

Before any titles or action, there is a short 
tutorial to orient the student to the touch- 
sensitive screen and keyboard, and the 
menus. If the learner is working independ- 
ently of a learning centre, this is always 
shown on the student's first use, and elec- 
tively thereafter. The tutorial uses com- 
puter graphics and animation, and is sup- 
ported by narration on the videodisc's sec- 
ond audio track. 

The setting is the Casualty Receiving Area 
(CRA) of a 250-bed Combat Zone Fleet 
Hospital. The CRA is in a large tent which 
there are a several casualties, some injured 
severely, some not There are litters and 
litter stands, and medical equipment and 
supplies needed to monitor and support 
the patients (IV's, AMBU bags and masks, 
endotracheal and chest tubes, portable 
Xray machines, blood pressure cuffs, and 
ECG monitors). 

Main characters are a non-surgeon medical 
officer (protagonist), an experienced fe- 
male nurse, a corpsman, and the triage 
officer, an experienced trauma surgeon. 
Extras are used in the background to simu- 
late a busy CRA. 



Meade, MD, using the Army's 10th MASH 
and Marine helicopter units from Quan- 
tico, VA. This establishes the combat 
ambience, and introduces the main charac- 
ters and situation, while presenting titles. 
Action movos from the general to the spe- 
cific, e.g, snowing groups of casualties 
being delivered to a field hospital by heli- 
copter or ambulance, litter-bearers scram- 
bling for casualties, a triage area, then into 
the CRA. 

All the simulated cases are the same charac- 
ter and have the same wound, a small 
penetrating injury to the left anterior tho- 
rax. Possible problems associated with this 
wound are presented to the student, who 
must recognize what they are, and decide 
what treatment to use. Problems include 
upper airway obstruction, simple and ten- 
sion pneumothorax, major and minor 
hemothorax, pericardial tamponade, ab- 
dominal hemorrhage with shock, and cer- 
vical spine fracture. 

Students receive final feedback on their 
performance in three forms: audiovisual 
communication delivered by the triage 
officer, numeric scores, and a medical re- 
sources impact statement. The score is 
subjective and intended only to rank this 
student against others. The impact state- 
ment assesses the student's efficiency in 
using medical resources: if unnecessary 
tests or procedures were ordered, the stu- 
dent is told how misuse of scarce resources 
can result in supplies not being available 
for the care of other patients. 

The major feedback to a care-provider is 
how well his patient does. Death of the 
patient is not presented, however. Instead, 
dangerous decisions by the student result 
in the triage officer taking over the case, 
which the student must then repeat. The 
program concludes by offering another 
case to the student. 



Computer-generated text and graphics 
overlie video footage shot on location at Ft. 



We feel this program is a good example of 
what can be done with interactive video to 
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simulate patient care situations. The mar- 
riage of computer and audiovisual in pre- 
senting content in realistic, clinically accu- 
rate, and dramatically absorbing ways 
makes for continuing medical education 
that can be worthwhile, rewarding, and 
enjoyable for the student. 
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Intelligent tutoring systems: Practice 
opportunities and explanatory models 

Alan Lesgold 

Learning Research and Development Center 
University of Pittsburgh 



I present examples of a focused practice system 
and an exploratory environment, both imple- 
mented using artificial in i elligence and graphics 
interface tools now becoming available. Then I 
describe a trouble-shooting tutor that combines 
these approaches. Finally, I discuss how the 
loose coupling of the two approaches affords 
opportunities for instruction in metacognitive 
skills. 

Two o f the ways in which computers can be 
used for education are (a) as vehicles for 
practice, and (b) as exploratory laborato- 
ries. Both of these modes of teaching and 
learning have a long history. Schools as- 
sign homework, which often consists of 
practice opportunities for refining knowl- 
edge that may have been presented for- 
mally in a class. Science courses, among 
others, often include laboratory sessions in 
which students learn basic principles and 
acquire a "feel" for a domain by exploring 
some of the systematic phenomena within 
that domain. 

Both practice and exploration have posed 
serious problems for educators. The prob- 
lem with practice is that students, left to 
their own devices, may end up practicing 
doing a procedure incorrectly — this often 
happens when children are given arithme- 
tic homework, for example. The problem 
with exploration is that not all students are 
equally facile at making the principled 
discoveries that would justify laboratory 
experiences. Many of our colleagues have 
found it possible to overcome these prob- 
lems, in whole or in part, by using the 
computer to present and monitor practice 
or exploration opportunities. 



My purpose in this presentation is to show 
ways in which some of the methods of 
artificial intelligence programming and 
screen interface design can be applied to 
these two instructional approaches of prac- 
tice and exploration. Then I will describe a 
specialized troubleshooting tutor that 
combines some of the properties of each 
approach. I will be presenting work that is, 
to a large extent, the work of colleagues and 
associates'. They deserve the credit for 
making these systems happen, though they 
may not necessarily agree with the asser- 
tions I am making about their products. 

Focused Practice Systems 

I turn first to an example of what I will call 
a focused practice system. Such systems 
are perhaps the oldest form of computer- 
assisted education we have. Their purpose 
is to present the student with opportunities 
to practice material that has been intro- 
duced previously, providing feedback 
about the student's performance. In more 
recent systems, there has been an increas- 
ing effort to provide coaching or help as 
well as post hoc feedback. In an era of 
management by objectives and emphasis 
on the bottom line, focused practice sys- 
tems seem to reflect an importani compo- 
nent of educational philo c " ^hy. The idea is 
to optimize students' time Dy assuring that 
they are practicing material that they are 
capable of mastering but have not yet 
mastered. 

Early focused practice systems concen- 
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trated on selecting the r? >ht level of prob- 
lems for the student and provided only 
binary feedback (correct or incorrect). Such 
systems, given sufficiently powerful pre- 
scription rules for deciding which exercises 
to present, have been shown to be effective 
for simple skill areas such as arithmetic. 
More recent efforts, such as the BIP system 
developed about a decade ago by Atkin- 
son, have moved to more complex practice 
tasks, such as programming assignments, 
and deeper, more knowledge- driven rules 
for problem prescription. For the teaching 
of procedural skills in relatively con- 
strained domains, focused practice envi- 
ronments are very powerful. Further, as 
you will see in the following example, they 
can be quite rich in the instruction they 
provide. 

An Example: Bridge 

Bridge is a practice environment for the 
skill of programming in Pascal (Bonar, 
Cunningham, Beatty, & Riggs, 1987). 
Rather than simply giving programming 
assignments, however, Bridge focuses the 
task of writing a program by guiding the 
student through three phases. 

In the first phase, Bridge asks the student to 
state, in natural language using menus, an 
informal plan for the program. In the sec- 
ond stage, the plan is formalized by ex- 
pressing it in a visual programming lan- 
guage. Finally, in the last phase, the stu- 
dent uses a structure editor to write an 
actual program. 

Figure 1 shows the screen display from the 
middleofthe first phase. The problem is on 
theleft,andtheemergingstudentplanison 
the right. Figure 2 shows the screen during 
the third phase. The visual plan con- 
structed bythe student ison the left, and the 
task is to build on the right an actual pro- 
gram that realizes the plan. 

Let me describe Bridge's three phases 
briefly. 



a. In the first phase, the student constructs 
a verbal statement describing what the 
program will have to do. The statement is 
constructed from a hierarchical menu of 
phrases which is based on extensive data 
on how students describe algorithms. The 
range of statements available allows for the 
emergence of common misconceptions 
about programing and the difference be- 
tween a statement that might sufficiently 
guide a person and a description of an 
algorithm. For example, students can de- 
scribe a loop by describing its first iteration 
and then saying "and so on..." 

The student's product is analyzed accord- 
ing to the level of detail it provides and the 
specific components of description that are 
present. This two-dimensional analysis 
allows the tutor to say to the student that he 
or she has a good basic account but needs to 
refine it, for example, rather than simply 
having to list what is missing. Bridge can 
infer the specific naive model of the student 
from the description he or she constructs. 
Sonar's most recent work is on a formal 
semantics for computer program plans that 
will permit the procedures needed for 
modeling a student's knowledge with re- 
spect to a programming problem to be 
generated automatically (Bonar & Liffick, 
1987). 

b. In the second phase, the verbal account 
of the student must elaborate the account 
into a plan or model of the program's func- 
tion. The components of this plan are 
graphic objects on the screen. Each object 
represents a basic building block of pro- 
grams, such as a loop that terminates when 
a specific control value is detected for a 
control variable or an input routine that 
fetches one integer. The overall plan for the 
program can be thought of as a system 
whose components are the low-level build- 
ing blocks. In order for the overall plan to 
be complete, the components must be con- 
nected in two ways, indicating control flow 
and data flow respectively. As can be seen 
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in Figure 2, control flow is marked by inter- 
locking the basic building blocks pieces, as 
in a jigsaw puzzle. Data flow is indicated 
by pointing first to a data source, such as an 
icon for a computed value, and then to a 
data port, such as the slot in an output plan 
that indicates what is to be output. 

The second phase plan can be run as if it 
wereamachine,Whenthisisdone,thedata 
values actually move around, and the 
building blocks reverse color as they exe- 
cute, so both data and control flow are 
illustrated. So, students finishing the sec- 
ond phase have a very specific mental pic- 
ture, expressed overtly o:\ the screen, of 
what their program will do. 

c. In the third phase, the student actually 
writes code. Two things are important to 
note here. First, the student doesn't get to 
this point until he has a clear plan, until he 
and the computer agree on what the goals 
of the program are. Further, the student 
can point to various parts of his plan and 
thereby indicate what piece of plan any 
given line of code corresponds to. 

Second, the usual frustrations of beginning 
programming, syntax mistakes, can be 
eliminated by providing structure editors 
that automatically assure the correct loca- 
tions of semicolons and other Pascal exot- 
ica. In an old- fashioned classroom, syntax 
errors may betray either low-level me- 
chanical failings or serious misconcep- 
tions. With the Bridge approach, such er- 
rors are inevitably mechanical. With a 
structure editor that allows building block 
shells to be selected from a menu, the syn- 
tax barrier is completely overcome. 

There are important reasons for using the 
intermediate representations in natural 
language and then in the visual program- 
ming language. Consider the task faced by 
a programming instructor in a course. The 
student has a program that is incorrect, and 
theinstructor must figure out what to say to 



the student. It is easy to label certain per- 
formances as wrong, but it is not so easy to 
communicate sufficient information to the 
student to assure that he will know how to 
do anything better next time. A good in- 
structor wiil ask the student what he was 
trying to do and then offer advice of the 
form, 'Tf you want to accomplish X then do 
Y." Intermediate planning languages serve 
the same function in Bridge. They allow the 
student to overtly express plans and inten- 
tions. With such languages, diagnosis in an 
intelligent tutor is enormously simplified. 

There is a second benefit to this approach. 
A basic characteristic of novice problem- 
solving performance is that it is too much 
centered on the specific tactics that are 
available and too little concerned with 
understanding the problem and develop- 
ing a plan for its solution. The intermediate 
languages of Bridge are planning lan- 
guages, so the student is being channeled 
into a more expert approach to problem 
solving, in which the problem and a plan 
for its solution are both represented clearly 
before coding starts. 

Overall, Bridge exemplifies three issues 
that are worthy of consideration in devel- 
oping focused practice environments: (a) 
focusing on parts of the performance that 
are usually internal, such as an initial prob- 
lem representation and a plan for solution; 
(b) using overt expressions by the student 
of plans and intentions to guide the coach- 
ing process; and (c) providing the student 
with tools, such as the structured editor, 
that maximize the proportion of time spent 
in significant problem solving practice. 

Exploratory Systems 

I turn now to an entirely different form of 
computer-based instruction, the labora- 
tory environment. Laboratory environ- 
ments, whether on computers or in more 
traditional form, are meant to deal with a 
specific problem. This is the large gap 
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between the ability to verbally state a prin- 
ciple and any understanding of that prin- 
ciple. It is generally believed that if stu- 
dents discover a principle themselves, then 
they will understand it, because it is 
grounded in their own personal experi- 
ence, whereas if they are simply told the 
rule, they may not clearly understand what 
phenomena the rule refers to. There are 
manyexperiencesineducation that seem to 
supportourfaithin discovery learning. For 
example, there are now quite a large num- 
ber of demonstrations that students who 
are quite able to solve textbook problems in 
physics are not able to apply the same prin- 
ciples they use for those problems to every- 
day situations. 

Discovery learning does have a problem, 
though. For the slower student, the wait 
until a discovery occurs can be very long, 
Regrettably, it is also the slower student 
who is less likely to expand beyond rote 
learning to actually understanding what 
principles of science or technology really 
mean. If we could somehow make discov- 
ery learning nrore efficient for the slower 
student, this would surely be a very worth- 
while thing to do. 

In order to tackle this goal, we need to view 
discovery learning as a form of problem 
solving. The problem to be solved is to 
specify the regularities present in some 
constrained environment, taking account 
of any additional constraints supplied by 
the teacher. Laboratory manuals generally 
consist of suggested activities followed by 
questions that are asked about those activi- 
ties. Implicitly, weare hoping that students 
will carry out the activity and then try to 
understand what they observed, using the 
questions of the lab manual as clues. Of 
course, not all students do this, so labs are 
not always effective. 

A good laboratory instructor might watch 
what the students are doing, examine the 
entries in their lab notebooks, and provide 
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some coaching that helped students not to 
miss important events and to be systematic 
in their explorations. A computer might 
also be able to provide coached laboratory 
experiences, and there are several good 
reason* for using a computer for this pur- 
pose, in addition to the serious interna- 
tional shortage of good science teachers. 
Computer-simulated experiments are eas- 
ily repeated and can be observed from 
many different viewpoints. They are safe, 
and they can be made relatively independ- 
ent of the motor skills of the student 

How can an effecave computer-based 
coached laboratory environment be devel- 
oped? We can get some good ideas by 
considering an exemplary piece of work 
done by some other colleagues at the 
Learning Research and Development Cen- 
ter, a tutor for a simulated economics labo- 
ratory they have called Smithtown. 

An Example: Smithtown 

Smithtown simulates a small town's econ- 
omy (Shute, Glaser & Raghavan, in press). 
The student can do experiments in which 
any of a set of factors (price, consumer 
preference, town population, mean in- 
come, minimum wage, weather, and num- 
ber of suppliers) can be manipulated for 
any of a set of commodities. The effect on 
quantity supplied and quantity demanded 
is then simulated. A variety of tools are 
provided to the student, including a note- 
book/database, graph plotting tools, and a 
means of expressing hypotheses about the 
effects of various manipulations. 

My colleagues have used Smithtown as a 
laboratory themselves, for studying how 
students use such laboratory environ- 
ments. By comparing students who seem 
to discover principles in their experimenta- 
tion in Smithtown with those who do not, 
and also by comparing students of differ- 
ing intelligence scores, they have been able 
to specify a set of behaviors that the better 
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students show when they experiment in 
this economics laboratory. They have then 
translated these findings into a set of ex- 
plicit rules for coaching exploration in this 
laboratory setting. The current version of 
Smithtown, then, can watch for evidence 
that a student is missing some of the ex- 
ploratory dispositions shown by expert 
learners and can then coach the student, 
suggesting more systematic approaches to 
experimentation. 

I will provide threeexamplesof the kindsof 
rides that Smithtown uses (Raghavan, per- 
sonal communication, 1987). Each deals 
with a different kind of experimental skill. 
The first is the most straightforward. 
Smithtown, like many laboratory situ- 
ations, has a number of variables that can 
be manipulated. However, it is virtually 
impossible to figure out what has hap- 
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pened if many variables are manipulated in 
each experiment. So, Smithtown has an 
internal watchdog or critic that watches to 
see if the student repeatedly manipulates 
multiple variables in a single experiment. 
When this happens, the following piece of 
advice is offered: 

To really understand causal relationship 
(how a change affects the market) , it is best 
to vary only one variable at a time. You 
have been manipulating too many vari- 
ables at a time. Modify this behavior to 
make things easier for yourself. 

A second example reflects a mixture of 
economic and more general strategic 
knowledge. If the student manipulates 
price of a good and then changes to a differ- 
ent commodity before seeing the effects of 
the prior price manipulation, there is a 



Figure 3: A Sample Screen from Smithtown 
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possibility that the price change in the first 
good might influence the price of the sec- 
ond good without the student even realiz- 
ing this. So, the student doing something 
like this is given an appropriate warning. 

The third kind of criticism is provided 
when the student's verbal hypotheses 
don't match well with his experimental 
behavior. For example, a good hypothesis 
should state an effect on a dependent vari- 
able that is produced by some manipula- 
tion of one or more independent variables. 
If a student claims that changes in a de- 
pendent variable produce some effect, this 
is worthy of coaching comment, and 
Smithtown provides this coaching. Over- 
all, the coaching aims at differences of the 
following kinds, that were found between 
faster and slower learners who used 
Smithtown: 

1. Generating and testing hypotheses. 

2. Engaging in richer experimentation 
within a single market setting rather 
than randomly changing markets. 

3. Replicating experiments to be sure that 
they knew what produced the effects. 

4. Changing one variable at a time, hold- 
ing everything else constant. 

5. Making big enough changes so that ef- 
fects could easily be noticed. 

6. Generalizing hypothesized effects 
across markets. 

7. Having systematic notebook skills. 

Overall,. then, Smithtown has provided 
evidence that skills associated with lesser 
learning ability can be tutored by a com- 
puter-based laboratory. An important 
question is whether the effects are local or 
general. That is, does the coaching merely 
improve the learning of economics from 
the economics tutor, or do the coached 
exploratory skills generalize to other labo- 
ratory situations. To test for this, my col- 
leagues have developed two other explora- 
tory environments, for simple electrical 
principles and for geometric optics, so they 



can begin to examine transfer between 
domains. 

Getting the Best of Both Worlds 

We've now considered two very different 
computer-based instruction paradigms, 
focused problem solving practice and labo- 
ratory exploration. Each contained a little 
bit of the other. For example, the second 
phase of Bridge, the visual programming 
phase, is partly a laboratory. One builds 
and runs program plans. Similarly, one can 
imagine making the exploratory econom- 
ics environment quite directive, with prob- 
lems like "What happens to quantity sup- 
plied as price rises?" However, we have 
not yet seen a systematic effort to combine 
exploratory environments with focused 
problem solving, and the design issues 
raised by such ? combination have not been 
fully explored. 

An instructional system my own labora- 
tory at LRDC has been working on pro- 
vides some opportunities for reflection on 
how the two approaches might be com- 
bined and on what concerns arise in such 
hybrid designs. We have been developing 
a tutor for a specialized electronics trou- 
bleshooting job in the U. S. Air Force. The 
people our tutor will train are responsible 
for repairing navigation equipment for a 
fighter plane. They have lots of trou- 
bleshooting guides and test equipment for 
doing this, and they do it well. 

However, the test station, forty cubic feet of 
electronics, that they use in their work also 
breaks from time to time, and fixing it is a 
lot harder than using it to fix parts from 
planes. Our tutor provides a partial simu- 
lation of this test station and also poses 
specific diagnosis problems. It provides 
advice and focuses problem solving activ- 
ity considerably, but it is also a reasonably 
rich exploratory environment, and we 
could make it richer. For example, within 
limits, we could probably produce an in- 
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structional system that would allow a stu- 
dent to ask for a simulation of the effects of 
any of a large set of component failures on 
overall test station performance. 

This project started when we were asked to 
take on a primary role in developing and 
testing methodology for a large Air Force 
effort to improve the quality of training and 
performance measurement for a number of 
their more technical occupational special- 
ties. Specifically, we were asked to explore 
the feasibility ot using cognitive psycho- 
logical approaches to task analysis 
(Lesgold, Lajoie, et al., 1986). As that work 
proceeded and cognitive task analysis 
approaches were developed, we were also 
asked to demonstrate the efficacy of our 
analytic approaches by showing that skills 
we identified as critical and not uniformly 
acquired would, if taught, make a differ- 
ence in airmen's job performance. This 
latter effort is now underway and involves 
development and field testing of an intelli- 
gent tutoring system. 

To carry out this project, we have had to 
develop cognitive task analysis techniques 
that we believe are of broad general inter- 
est. In particular, we have developed a 
combination of structured interview and 
think-aloud protocol that seems quite gen- 
erally useful. Several other approaches we 
have developed (Cf . Lesgold, Lajoie et al., 
1986) also seem likely to be useful. Further, 
we have found it beneficial to compare 
subjects at multiple levels of competence, 
so that we can describe competence as the 
presence or absence of certain key features 
during realistic (job-like) problem solving 
performances. The features, in turn, signal 
specific procedural knowledge that seems 
to be differentially acquired by those who 
learn well on the job. Our current task is to 
tiy, via intelligent coached practice in a 
simulated job environment, to provide this 
procedural knowledge and related concep- 
tual (declarative) knowledge to those air- 
men who do not already have it. Let me 



take just a minute or two to describe the 
structured interview technique, since I 
think you will find it useful. 

Structured Interviews during Problem Solv- 
ing: The Concept of Effective Problem Space 

In our first effort to develop a task analysis 
scheme that would be sufficient to inform 
development of an intelligent instructional 
system, Drew Gitomer developed a trou- 
bleshooting task that involved detection of 
complex faults in the test station used by 
our subjects — prior Air Force data sug- 
gested that this was their hardest job. As a 
fust formative approach, he simply vide- 
otaped subjects attempting to solve such 
fault detection problems. He then exam- 
ined the protocols (transcriptions of the 
tapes) and attempted to count a variety of 
activities that seemed relevant to metacog- 
nitive as well as more tactical aspects of 
problem solving in this domain. While the 
results, published in his thesis (Gitomer, 
1984), were of great interest, we wanted to 
move toward a testing approach that was 
less de k endent upon skilled cognitive psy- 
chological training. That, after all, is one 
aspect of what test development is largely 
about — rendering explicit the procedures 
that insightful researchers first apply in 
their laboratories to study learning and 
thinking. Also, we felt that in a technical 
skill, much of a person's capability is very 
much grounded in the specifics of the task 
(cf. Scribner, 1984). Thus, we expected a 
method more heavily driven by domain 
expertise to be more productive than a 
'\veak method/' 

In fact, our breakthrough came not so much 
from our psychological expertise but rather 
from interactions of the three of us, who 
had substantial cognitive psychological 
training, with an electronics expert, who 
had extensive experience watching novice 
troubleshooting performances. He 
pointed out that it was quite possible to 
specify the entire effective problem space, 
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even for very complex troubleshooting 
problems. That is, he could pretty com- 
pletely tell the rest of us all of the steps that 
an expert would take as well as all of the 
steps that any novice wasat all likely to take 
in solving even very complex troubleshoot- 
ing problems. In this case, the task was to 
find the source of a failure in a test station 
that contained perhaps 40 cubic feet of 
printed circuit boards, cables, and connec- 
tors, but various specific aspects of the job 
situation constrained the task sufficiently 
so that the effective problem space could be 
mapped out. 

This then created the possibility that we 
could specify in advance a set of probe 
questions that would get us the informa- 
tion we wanted about subjects' planning 
and other metacognitive activitv in the 
troubleshooting task. For what L probably 
the most complex troubleshooting task we 
have ever seen, there are perhaps 55 to 60 
different nodes in the problem space, and 
we have specific metacognitive probe 
questions for perhaps 45. 

Figure 4 provides an example of a small 
piece of the problem space and the ques- 
tions we have developed for it. 

An examination of the questions in the 
Figure reveals that some are aimed at very 
specific knowledge (e.g., How would you 
do this?), while others help elaborate the 
subject's plan for troubleshooting (con- 
sider Why would you do this? or What do 
you plan to do next?). Combined with 
information about the order in which the 
subject worked in different parts of the 
problem space, this probe information 
permits reconstruction of the subject's plan 
for finding the fault in the circuit and even 
provides some information about the 
points along the way at which different 
aspects of the planning occurred. In fact, 
we went a step further and also asked a 
number of specific questions about how 
critical components work and what their 



purpose is. Finally, when a subject was 
headed well away from a reasonable solu- 
tion path, we would, at preplanned points, 
redirect his efforts back to more fertile 
ground. 

In more recent work, we have standardized 
a set of questions that are asked at each 
node of the problem space. These ques- 
tions address the precursor assumptions 
implicit in reaching a given point of the 
problem space, the action to be taken at that 
point, the expected results of that action, 
and the interpretation of the results both in 
terms of a model of the device and in terms 
of appropriate next steps. We call this the 
PARI technology, because it focuses on the 
Precursor, Action, Result, and Interpreta- 
tion at each node of the problem space. 

Christopher Roth and Gaiy Eggan have 
taken our methods and applied them to a 
slight variant of the domain we studied. 
However, they spent more of the total ef- 
fort comparing the specific problem-space 
paths of experts and novices. The next few 
figures illustrate the yield of this work. 
Roth worked with Eggan to develop a col- 
lection of diagnosis problems that were 
characteristic of real problems faced in the 
work environment and that were likely to 
be solved correctly by the best technicians 
and not by many of the less skilled, first- 
term airmen. People with experience in 
handling the tasks on which many airmen 
have difficulty tend to have a good sense of 
the kinds of problems that are in this class 
(representative of the domain, solvable by 
the better technicians, and not solvable by a 
substantial number of workers), and 
Eggan's advice has proven itself empiri- 
cally. 

Figure 5 illustrates the effective problem 
space that Eggan helped Roth construct for 
the problem. It was felt that the bulk of 
problem solving activity would fall within 
this space, for both experts and less-skilled 
workers. 
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* Why did you rerun the test? 




* Why would you do this? 

* How would you do it? 

* What does it tell you? 



* Why would you do this? 



M/ 
Reseat/ 
Swap 
A2A3A11 




* How do you do this? 

* Why would you do this? 




* How do you do this? 

* Why would you do this? 

* Is this what you would do 
in the shop? 




*How do you do this? 

* Why would you do this? 

* Is this what you would do 
in the shop? 



* What do you think the problem is? 

* What do ycu plan to do next? 



Figure 4: Effective Problem Space Methodology — First Version 
O O ft 
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Figure 5: Effective Problem space Segment, Showing Expert-Novice Differences 



Roth and Eggan then proceeded to run 
subjects on this task. The problem was 
posed verbally to airmen who had access to 
the full set of Technical Orders (documen- 
tation for the devices involved). Techni- 
cians were encouraged to offer their hy- 
potheses, state their plans, and announce 



specific steps they would take in attacking 
the problem. Whenever an overt step was 
stated by a subject, he was immediately 
informed of the outcome of that step. 

Figure 5 also shows the basic results Roth 
and Eggan obtained. The experts, whose 
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performance is outlined with a solid line, 
used a subset of the effective problem 
space, avoiding some of the steps thrt were 
less likely to be productive. The novices, 
whose empirical problem space is outlined 
in heavy dashes, failed to make some of the 
expert moves and made some moves that 
experts would not make, such as swapping 
a disc pack (see bottom left of Figure 5). 
Further, their empirical problem space was 
discontinuous, a set of islands. To b, ^er 
understand what knowledge separated tne 
experts from the novices, Roth and Eggan 
then tried to determine the specific knowl- 
edge that experts used at critical points in 
the problem space. Knowledge involved in 
making a move that experts make and 
novices do not is a clear candidate for 
additional training. 

A final issue that Roth and Eggan ad- 
dressed was the matter of the discontinui- 
ties in novice problem spaces. In essence, 
the gaps represent impasse points where 
the novice does not know what to do. At 
those gaps, we see relatively random be- 
havior, driven by the snippets of knowl- 
edge the novice has. For example, in the 
case shown in Figure 5, there is initially a 
period of board swapping that is not di- 
rected specifically at the problem. Then, 
there is an effort to think about the path 
involved in a download. The multiplexor 
(MUX) somehow becomes the focus of at- 
tention, and thought about the MUX con- 
tinues until the novice isredirected toward 
the disc drive, whereupon the right possi- 
bilities are addressed, but without concern 
about the relative costs ana benefits of the 
five alternatives. 

From Testing to Tutor Development 

The Effective Problem Space PARI technol- 
ogy gives us two things we need in order to 
build an intelligent tutor a technology for 
deciding what to teach; and a technology 
for constructing individual problems for 
the tutor to present. The decisions on what 



to teach come from comparisons between 
effective and less effective workers in the 
job environment. In the case of our tutor, 
such comparisons showed us that we 
needed to focus on tracing of signals 
through schematic diagrams, the more 
sophisticated uses of test equipment, men- 
tal models of the process, within the test 
station, of carrying out a test of an aircraf t 
component, and domain-specific customi- 
zations of some general troubleshooting 
strategies. We then put our subject matter 
experts to wcrk generating problems that 
treated the issues we had identified and 
that involved various parts of the test sta- 
tion. For each problem, we have an effec- 
tive problem space data structure that 
contains all the information needed to 
interact with the trainees as they attempt to 
solve the problem. 

Each node of the effective problem space 
for a problem is represented as an instance 
of a computational object. When the 
trainee chooses to move to a node of the 
problem space, its corresponding object 
receives a message telling it to take charge 
of interactions with the trainee. The object 
has the ability to generate certain kinds of 
hints and contains specific text for other 
hints that might be needed at that point. It 
knows what actions can be performed at 
this point, what prerequisites those actions 
might require (e.g., shutting off power 
before removing a card from the station, 
getting the right schematic for circuit trac- 
ing, etc.), what the results of those actions 
are and what they mean, and what options 
to present to the trainee as the next step. 
Each node also contains a list of the curricu- 
lum goals relevant to it. 

This curriculum goal information lays the 
basis for the student modeling activity that 
is needed to assign problems to the trainee 
and to decide how supportive to be in offer- 
ing help at various points in the trainee's 
efforts to solve a problem. The student 
modeling process we use is still very primi- 
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tive. When a student starts a problem, an 
estimate is made of his likelihood of suc- 
cessfully negotiating each node of the prob- 
lem space. This estimate is made on the 
basis of a long-term student model that 
shows the learning state of each curriculum 
issue If the student has mastered the issues 
relevant to a node, then we can expect him 
to do well at that node and can therefore 
give only subtle hints. On the other hand, 
if we know a node requires knowledge the 
student has not exhibited, we should pro- 
vide more explicit help. Our categories are 
currently single: Good, OK, and Bad are 
the possible levels of expectation for any 
given node. We call the expectation infor- 
mation that is generated for a specific prob- 
lem when a trainee attempts it the perform- 
ance model of the student for that problem. 
After the problem is completed, deviations 
of the performance model from actual stu- 
dent performance (e.g., did he breeze 
through a spot where he was expected to 
have trouble, or did he ask for lots of hints 
at a spot he should have been able to 
handle) are used to update the ratings as- 
signed to each curriculum issue for that 
student. We call these ratings the compe- 
tence model of the student 

So, we assign a problem by matching prob- 
lem characteristics with cur current assess- 
ment of what the student knows how to do, 
we generate an expectation of his perform- 
ance at each point in the problem space by 
noting what curricular issues are relevant 
at that point and what we know about the 
trainee's competence on those issues, and 
then, after the problem is completed, we 
update the competence model to reflect 
unexpected aspects of trainee performance 
as he went through the problem. 

Adding an Exploratory Component 

So far, what I have described is a focused 
problem solving tutor. We give the student 
a problem and, as necessary, provide hints 
that keep him focused on its solution. The 



next step was to add an exploratory compo- 
nent that permitted the student to tiy out 
some of his ideas. We did this by adding a 
simulation of the front panels of the test 
station and an ability to conduct simulated 
tests of the test station circuitry by placing 
meter probe icons at various points in sche- 
matic diagrams of the innards of the test 
station. 

A few pictures are worth many words here. 
Figure 6 shows the screen in the midst of a 
problem. A representation of the front of 
the test station is shown. Pressing the 
mouse button in any of the 12 boxes on the 
left would cause the front panel corre- 
sponding to that part of t£te test station to 
appear. The choice of how to proceed from 
the curren t problem space node is made by 
selecting from the menu on the right. The 
picture was taken right after the student 
asked for a hint, which can be seen in the 
information box in the upper left 

Figure 7 shows the screen after one of the 
front panels has been requested. The stu- 
dent can move knobs by mousing the set- 
ting he wants. When knobs are moved, 
meters automatically update. The student 
can also request documentation on the 
screen. 

Figure 8 shows a page of the Technical 
Orders, which are the documentation for 
the test station. They are accessed via an 
index on which the student can mouse- 
button for the entry he desires. 

Finally, Figure 9 shows a schematic dia- 
gram. The student can ask for measure- 
ments of voltage, current, or resistance 
values by calling up an icon of a meter, 
setting its front panel, and then indicating 
where its probes should be placed in the 
schematic diagram. The upper left of the 
schematic has above it the icon for a 
Simpson multimeter, and its red and black 
probes have been placed near the middle of 
the schematic on the left (the red probe 

2d 



20 



Ht^Mrt«»M t»r*»«4mn hr^pi ^ mm *h»vh *W tfct M TO 



Using Computers Intelligently 



lAIAt 



1MAJ 

tu 



fAIAf 
M4ACM 



1A1AI 
WW 



IA1M 



2AIA2 



2A1M 
VAftDCK 




T1CT ITATKW 
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Figure 8: Sherlock Screen Showing a Page of Documentation 



looks like a meter probe, and the black 
probe looks like the symbol for ground). 
Obviously, there are test point combina- 
tions for which we will not be able to pro- 
vide result values, but the number of test 
values seems to be adequate so far. 

CouplingtheExpbratoryEmnronmentand the 
Focused Problem Solving Tutor 

The remaining task is to couple the explora- 
tory environment, the simulation of the test 
station, wi*h the menu-driven focused 
problem solving tutor. This is done in a 
very simple way. At some, but not all, 
points in the course of problem solution, 
the menu includes the option of doing a 
test. When the trainee takes that option, he 
gains access to the exploratory environ- 
ment. The tutor can control what explora- 
tions he is permitted, allowing either gen- 



eral exploration or restricting exploration 
to a specific circuit competent. When the 
trainee tries to perform a specific test, he 
must, of necessity, have in front of him the 
schenul'c that shows the points at which he 
wants to make a measurement. When he 
tries to make a measurement, the object in 
charge of that schematic can impose special 
conditions, such as turning off the power, 
before the test is permitted. Similarly, the 
object representing the test instrument may 
impose conditions on how it can be set. 
When all conditions are satisfied and the 
probes are placed, the meter icon is auto- 
matically updated to show the test value. 

The system keeps a record of all tests it 
performs. When the student indicates that 
he is done performing tests, a miniproduc- 
tion system attached to the sche;natics on 
which tests have been performed is al- 
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Figure 9: Sherlock Screen Showing a Testable Schematic 



lowed to execute. It contains rules that 
show the relationship between various 
prcblem-space activities and various tests. 
A rule might say that if certain parts of the 
problem space have already been negoti- 
ated and certain testsare performed, then a 
large portion of the test station is ruled out 
as the cause of the fault being diagnosed. 
The problem space nodes relevant to work 
in the ruled-out portion are notified that 
they are no longer necessary steps. Later, if 
the student enters ruled-out portions of the 
problem space, he may be allowed to pro- 
ceed but will eventually be told that he 
really had ruled out those possibilities 
when he was performed a test earlier (the 
test can be described, of course). 



So, with a relatively simple convention, a 
production system that inter-relates ex- 
ploratory actions with the representation 
of the problem space, we can couple the 
two approaches. We currently write pro- 
ductions by hand to do this, but it is proba- 
bly possible to build intelligent compo- 
nents to do this automatically, assuming 
that the semantics of each problem space 
object are part of its knowledge. One 
would simply ask the objects relevant to the 
part of the test station that had been ex- 
plored to decide whether the tests that were 
done were relevant to themselves. When 
an object decided that a test was relevant to 
itself, it would, given an appropriate 
method, then decide what the effect of 
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conducting the test should be on the rele- 
vance of that point of the problem space for 
further search. 

On the Value of Not Being Perfect 

I conclude by noting that the techniques we 
have used are provably incomplete. Theo- 
retically, there are actions that a trainee 
could want to take that are not represented 
in our effective problem spaces, and there 
are sensible tests one could perform that 
our experts might not anticipate. The 
hypothesis we are now testing by taking 
our tutor to the field is that such imperfect 
approaches can still provide lots of useful 
instruction. It is not clear that a complete 
simulation of jl device as complex as the test 
station we are working with can be devel- 
oped at an affordable price. Further, per- 
fection, while it may be comforting to the 
designer, may not be necessary to effective 
instruction. We see ourselves as involved 
in an activity sunilar to that of many indus- 
trial designers, designing a system which is 
not perfect but which can accommodate, 
through a variety of mid-course correc- 
tions, to any problems for which it was not 
fully prepared. 

One of our accommodation techniques, the 
panic button, has actually turned out to be 
quite interesting as a new source of instruc- 
tion. When the tutor completely loses track 
of where the trainee is in the problem space, 
perhaps because the set of tests the trainee 
performed in the exploratory environment 
was pretty random, it tells the student this. 
Also, when the student is stumped and the 
hints he is getting are no t helpful, he can hit 
the panic button. In panic mode, the tutor 
works with the student in a top-down 
manner, discussing what the student has 
done so far and what parts of the problem 
space remain unsearched. It then asks the 
student to proceed from the top, specifying 
which subspace and which subsubspace, 
etc., he wishes to enter. Put another way, 
when the tutor doesn't know what to do, it 



carries out, and thereby demonstrates, a 
systematic set of metacognitive strategies 
that the trainee would do well to model. 

Heidegger observed that for the most part 
we are controlled by our recurrent, every- 
day, expected environment. Only when 
breakdowns occur in the expected situ- 
ation do we have to think about what to do. 
Only then can we learn. An interesting 
accident of the approach we have taken in 
designing our tutor is that we cannot avoid 
some breakdowns of the tutoring process. 
Upon reflection, these breakdowns may be 
the best opportunities for teaching that our 
tutor has, and the default techniques it can 
apply may be useful techniques for the 
trainee to encounter and to see demon- 
strated. 

In the complex interdisciplinary world of 
computer technologies for education, I 
expect to make many mistakes, to seldom 
produce perfect instruction. Consequently, 
I look for ways to build on mistakes and 
insufficiencies because I can count on hav- 
ing them. At the moment, it looks as if this 
is a fruitful way to proceed. 
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In 1906 the Commonwealth Tertiary Education 
Commission, through the Participation in Eq- 
uity Program, supported the Physics Literacy 
Project This was a proposal to devise a number 
of computer assisted learning packages to assist 
students vith little or no background in Physics, 
to overcome the initial hurdles to a Tertiary 
Physiol course. As the program matured this 
had developed into seven CAL programs using 
the Macintosh computer and deprogramming 
language Forth. The project has a strong em* 
pha^onexperientiallearningo^ 
using simulations. This paper describes the 
progress of the project and will present a num- 
ber of issues relevant to the production of CAL 
material and particularly CAL material using 
simulations. 



The Physics Literacy Project was reported 
on at CAUTE - 85 (Bailey 1985) indicating 
the origins of the project from a concern 
over students who were attempting terti- 
ary Physics programs with a lade of secon- 
dary background in Physics. This concern 
is supported year after year at many insti- 
tutions by a continued attrition or high 
failure rate amongst these students (80 - 95 
%> 

One approach towards assisting these stu- 
dents is to produce Computer Assisted 
Learning (CAL) material. This project se- 
lected 7 topic areas and work has pro- 
ceeded towards producing teaching mate- 
rial for the Macintosh computer using 
Forth as a programming language. The 
justification for the computer choice was 
based on the interaction possible via mouse 
between operator and machine which (a) 
reduces the need for keyboard skills by the 



student and (b) gives the student a "hands- 
on" physical experience of controlling di- 
rectly the on-screen events. Despite diffi- 
culties experienced with the language and 
its implementation on our basic512 KMacs 
and the lack of acceptable large screen 
projection facilities we are still delighted 
with our choice of machine and method of 
operation. 

The Project 

The initial proposals emphasised the team 
design of software modeled on Bork (1984). 
This has had mixed success. For the team 
members the process has been very re- 
warding as it has forced them to go back to 
basics and to examine seriously their teach- 
ing approaches. However some designers 
preferred to work as individuals and some 
teams lost members due to commitments 
outside the project. 

It was also found that the revision and 
design process needed feedback from us- 
ing the machine and this was not always 
available. Due to the quaint way funding 
works, the project has had two program- 
mers, both on one year contracts. Part of 
their time has been spent learning the 
machine and language before producing 
product. Early work has concentrated on 
the production of graphic sequences to- 
wards later incorporation into teaching 
sequences. Thishasresultedinanumberof 
exciting mini programs of great v&Iuo 
towards supporting a teaching program 
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but unfortunately not specifically appropri- 
ate to the immediate goals of the project. 

Work in progress 

At the time of writing this paper eight appli- 
cation packages have been completed in 
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preparation for trialling. It is anticipated 
by December that a substantially larger 
number will be available for demonstra- 
tion, for assessment and for feedback sug- 
gestions. Screen dumps of representative 
portions of each of these are included for 
information. 
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Figure 1. Dropping. Conservation of momentum is illustrated with student control over 
the mass of both trolley and brick. 
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Colliding. Elastic collisions are accessible for a range of masses from 1:9 to 9:1. 
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Fig 3. Sticking. Inelastic collisions with variable mass ratios and total mass are avail- 
able in this program. 
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Fig 4.1 Exploding. As with other momentum simulations this enables the student to 
vary the mass of the gun and projectile over a wide range. 
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Fig 5. Pressure/Volume. The properties of a gas depend on a number of variables. Here 
a student can vary either the Pressure or the Temperature and observe the volume and 
pressure changes. 




Fig 6. Spring. The extension of a spring of variable stiffness can be examined for a 
range of masses. 
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Fig 7. Viscosity. The terminal velocity of a sphere gjves an exceUent experiment for ratio 
and proportion. 
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Fig 8. Circuit I. The linear relationship between Voltage and Current can be seen as 
the student varies the control boxes and if needed the value of the resistance and the 
experiment repeated. 
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The original seven programs were to be in 
the areas of: 

Motion 

Forces 

Momentum 

Work and Energy 

Properties of Matter 

Fields 

Experimental Methods. 

The graphic sequences chosen sometimes 
fall into more than one of the above catego- 
ries and this is done deliberately to enhance 
learningby familiarity. Thus Experimental 
Methods is concerned with ratio and pro- 
portion and will call on any sequence with 
linear characteristics as a suitable learner 
experience. The .learner may also see the 
same graphic sequence elsewhere under 
Motion or Properties of Matter. 

Conclusion 

This project is far from concluded. It has 
opened up a wealth of opportunities and 



ideas for ways in which the teaching of 
Physics can be improved and specifically it 
has leid to our teaching staff having access 
to a number of instant experiments in a box 
(the Macintosh) for illustrating and sup- 
porting their teaching. 

The sequences will be connected together 
and made available, on request to other 
institutions and hopefully will serve at a 
catalysl to foster further development and 
exchange of disks. One other institution 
has already indicated its interest in specifi- 
cally developing teaching sequences and 
this could lead to further exchanges. 
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A program hm been written, for the IBM/PC 
series, which deduces how a ptir of organic 
chemicals wo- 'Id react with one another or with 
common reagents. It is a forward chaining infer- 
ence system which makes use of separate 
knowledge base of rules concerning organic 
functional groups and multiple bonds* The 
knowledge may be added to or modified by the 
user, though the supplied set of rules is fairly 
comprehensive and covers the main reactions 
which students will encounter to the middle of 
their tertiary year. The system should be of use, 
therefore, to chemistry undergraduates a» well 
as be of interest to others concerned with the 
representation of complex knowledge. 

Chemical Computing. 

Alongside the development of FORTRAN 
and LISP in the early sixties came the ever 
increasing use of computers in ch2mistry. 
In fact, in most universities the chemistry 
department was one of the main users of 
the computing facilities. Of course their 
work was all to do with number crunching 
and for the most part still is. Fortran is still 
the language used and will probably re- 
main so for some time to come since it 
produces fast code and there is a large 
investment in the form of existing pro- 
grams. These programs are available 
through an organized software sharing 
facility that has been in existence for over 15 
years. 

However chemistry as a whole is a mixture 
of science and art in the way that good 
cooking is, so that although recipes can be 
written down, it still takes a good chemical 
cook to turn the recipe into a product or 
invent a new one. So one way that I like to 



look at Oiganic chemistry is to compare it 
with a game of chess r here the rules are 
definable ( at least tt some extent), the 
strategies are understandable but the game 
is is complex 

A student of organic chemistry has first to 
learn the language of valency and rules for 
the connection of atoms. Then the atom;* 
are clustered together into so-called func- 
tional groups, which are groups of atoms 
that can b$ thought of as a whole and from 
which larger entities, molecules, can be 
built. There are no absolute rules as to what 
constitutes a function?. 1 group as against 
some arbitrary group but there is a general 
agreement with many exceptions. 

The chemistry of a molecule can, in part be 
derived from its constituent functional 
groups and the bond types (single, double 
etc.) that connect them. This then forms a 
good start for thinking about the encoding 
of the rules of organic chemistry. Of course 
this is not the whole story else it would all 
be too simple to bother with; however it is 
enough for a beginning. 

The original purpose of the program was to 
investigate the extent to wldch organic 
chemistry was amenable to being encoded 
in a logical manner. Somewhere along the 
way the aim was changed to producing a 
package that would be useful to students, 
after the scope and limitations of the origi- 
nal purpose had been defined. 

The initial challenge was to encode the 
rules that relate ta the reactivity of the 
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functional groups and their associated 
bond types. The main criteria is that a pair 
of chemical compounds be typed in at the 
keyboard, or retrieved from a file, and a set 
of possibleproduct molecules bedisplayed 
after computation. The chemical input and 
output to be as near as practicable to nor- 
mal chemical conventions and the rules to 
cover the main possibilities. 

The language choice foils between a proce- 
dural language such as Pascal and a de- 
clarative language such as Prolog. How- 
ever one of the constraints in the present 
case was that theprogram should be under- 
standable and modifiable by a range of 
chemists and chemical undergraduates. 
Pascal was chosen since it also has some 
natural advantages for chemistry in that i ts 
record and pointer types match the atomic 
and bond properties of atom? in molecules. 
Hence each record can include several 
pointers to other records and so, between 
them, form a graph which can represent a 
chemical structure. 

Turbo Pascal©, together with some ex- 
tender packages, was chosen on the 
grounds that a large number of these com- 
pilers were thready in use and therefore 
users would hav* the potential to change 
any source code provided. In the event so 
far only compiled code has been circulated. 

Painters and Valency 

The program inputs a string whose syntax 
is as doseaspossible to the accepted way of 
writing a chemical formula; the limitations 
being in the super- and sub-scripting which 
is commonly used. Of course chemists 
prefer to write two-dimensional diagrams 
to represent molecules. Parsing such dia- 
grams would be an extremely complex task 
and well outside the scope of this project 
though it must be recognized as a limita- 
tion and a barrier to the acceptance of such 
programs by chemists. 

In fact it is not always recognized by 'com- 
puter illiterate' chemists that there is a dif- 

O 



ficulty in this area as they have become 
familiar with specialized chemical word 
processors which enable them to place such 
diagrams in their documents. The 
enormous difference between going from a 
string to a diagram and from a diagram to 
a string is not obvious to them. 

The string then has to be parsed into func- 
tional groups, bonds and other chemical 
syntactical symbols, all of which is made 
into a linked list of symbol groups. This list 
is then further parsed into a graph where 
each node is a record containing chemical 
information pertinent to the functional 
group and pointers to other atom records. 

At this point is is easier if the molecular 
graph is thought of as a mobile ( as used 
over children's cots) with the functional 
groups as the objects and the valency point- 
ers as the strings. The object of the rules is to 
manipulate, add to and partly alter the 
mobiles. 

The rules that will decide how two mole- 
cules react with one another are really rules 
of interaction between functional groups 
and functional groups or between func- 
tional groups and bonds. Hence a list of all 
such appropriate pairs can be made and 
then compared with an external database. 

The encoding of rules and the Action 
types. 

The external database was referenced to a 
well known organic chemistry textbook 
(Morrison and Boyd, 'Organic Chemistry) 
and at present con tains about 150 rules. The 
reaction list is first pruned of the non act- 
ing pairs and the remaining rules acted 
upon at the discretion of the operator. 

The rules and the lunctional groups are all 
encoded with a two character code for 
compactness and ease of reference. 

Oneof the codes contained within each rule 
is an action code. This code specifies a 
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particular Pascal procedure which will 
combine and rearrange the original (reao 
tant) molecules in a particular manner 
pertinent to the reaction under considera- 
tion. The other codes contained within a 
rule specify how the functional groups of 
the original molecules are to modified 
upon reaction. Finally there are also codes 
to specify the conditions under which the 
reaction might take place (eg. heaUdd 
etc). 

The result of using the action procedure is 
to produce one or two new molecular 
graphs which represent the product mole- 
cules, and can themselves be re-manipu- 
lated and even reacted further with other 
molecules. 

The program. 

The program as a whole has been con- 
structed to present in a professional man- 
ner, in contrast to many extant chemistry 
tutorial programs. An in-built editor is 
provided for typing in the molecules; help 
windows may be switched on and off; in- 
formation windows pop down when some 
rules are fired, and the disk may be 
browsed for pre-recorded data. 

The program may be viewed as a chemical 
calculator where molecules are input in- 
stead of numbers. It does not however, 
address the problem of synthesis which is a 
problem of greater complexity, though an 
attempt at a restricted synthesis program 
may he made next year. 

The program should prove useful to Aus- 
tralian first- and second-year chemistry 
undergraduates and their teachers. It may 
also prove interesting to those who wish to 
brush up their organic chemistry and even 
to those who are interested in the represen- 
tation of complex knowledge. 



Marketing and copyright 

A part of this years program is to be de- 
voted to the marketing and copyright as- 
pects of programs written by academics. 
The law, and some of the larger software 
houses, seems to want to treat software in a 
similar manner to books. If this is the case 
then there is no problem as academics have 
always written books and usually kept the 
royalties, wl^ch rarely amount to a fortune. 
Itis important, and in keeping with thenew 
political philosophy, that individuals be 
motivated to produce innovative ideas. 
Program writing is a difficult lengthy and 
often tedious business for which there is the 
need for the prospect of a positive bonus. If 
the nation is to keep up with the trends in 
the ever changing world of computing and 
computer aided learning then such encour- 
agement is needed. Of course, where grants 
are provided it up to those concerned to 
negotiate their own contracts which may or 
may not involve the ownership of copy- 
right. 

In my own case I have attempted to market 
the program myself under the name 
LogiChem and an organizational name of 
ChemSoft, which are registered business 
names. I took this course as there does not 
seem to be a suitable avenue for distribut- 
ing chemical software to chemists in a 
commercial manner. The second advan- 
tage of doing this is that one is able to 
interact with the business community on 
an equal footing, which in itself promotes a 
better understanding of other peoples 
problems in both directions. 



Dr. Frank Burden is Senior Lecturer in 
Chemistry at Monash University, his 
research interests are in the quantum- 
dynamics of small molecules and the 
production of expert systems for chem- 
istry. 



I Grabbing knowledge graphically 

jp KayFielden 

gjjk School of Information Sciences and Engineering 

ff£ Canberra College of Advanced Education 



Iconic interface* of nuchine* like the Macintosh 
provide valuable and novel wayi in which 
knowled** acquisition may be enhanced A 
knowledge aapiainta 

to deeign ami create problem solving tafks by 
aimpi* graphic interaction. In a <r strolled 
domain where object* an mapped oWdy onto 
krofosimulatiartadearme^ 
formedby metier. Ej^Wttogmecmtrolsm^ 
tureaof the iconic interface, that is, menus, but- 
ton* and superimposed window* forcea a dis- 
tinct and unambiguou* mental model of how 
the Simula^ is operated Adopting a struc- 
tured approach in designing the interface en- 
hances knowledge acquisition. 



neer requires a deep understanding of the 
system domain to select an appropriate 
representation. 

Simulation of an object-oriented environ- 
ment is an ideal domain for utilizing direct 
graphic interaction. This paper will discuss 
a knowledge acquisition tool designed for 
use within an authoring system environ- 
ment 

Authoring Systems Environments 



While acquiring knowledge from experts Application of graphic interaction to au- 
has been regarded as one of the major Coring systems environments enables 
bottle-necks far the construction of intelli- specialist teachers to concentrate on the 
gent systems (Young, 1984),theunderlying domain under consideration, with the 
problem appears to be in knowledge repre- computer system becoming 'invisible', 
saltation. Once expertise has been ac- 
quired by a specialist, that knowledge Any domain which can be represented as a 
appeaistobestoredinthej^edaUst'fmmd state/space relationship with constraints 



in 'capsule 7 form. Acquiring detailed 
knowledge therefore becomes a difficult 
step, as the specialist often can no longer 
articulate these details. Traditional knowl- 
edge gathering techniques: form filling, 
questionnaires and interviews all require a 
translation process by a knowledge engi- 
neer in order to get the knowledge into the 
system. Aiello (1987) suggests that a rich 
variety of knowledge representations are 
required to allow selection of an appropri- 
ate representation. 

The translation process required by the 



on the movement and relationship of ob- 
jects to each and to the domain space is 
suitable for simulation and graphic interac- 
tion. 

By adopting the same strategy described by 
Finzer &Gould (1984): 'only things thatcan 
be seen can be manipulated', specialist 
teachers can design their own simulated 
tasks and implement their own creative 
ideas, thus eliminating the need for pro- 
grammers in the design of software. Not 
only does task creation in such an environ- 
ment constitute a new medium for the 



knowledge engineer in traditional systems presentation of information and concepts, 
can be side-stepped by the use of simple it also provides new ways to gather kno wl- 
Braphic interaction. The knowledge engi- edgebothaboutthedomainandthecontrol 
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structure for the domain and for the simu- 
lated system. 

Knowledge Acquisition Tools 

Although many researchers agree that in- 
terface design is domain dependent (Hoi- 
lan, 1984, Aiello, 1987, Norman 1987) the 
availability of a rich variety of knowledge 
representations enables the selection of the 
most appropriate representation. While 
presentation of the domain under consid- 
eration need not necessarily be directly 
related the representational system, the 
more direct the mapping, the clearer the 
mental model. The picture on the screen 
should be close to the real world. In the 
world of simulated physical environments, 
direct mapping from the real world is pos- 
sible via the use of direct manipulation in 
an object-based system. Movement of 
physical objects in the real world can be 
mapped directly on to the simulated sys- 
tem by direct manipulation (Figure 1(a). 

Domain 



However, control of the real world system 
is often inarticulated, details of control 
having become automatic for specialist 
users. To the knowledge engineer, gather- 
ing information about control of a task is 
difficult. The mental model is not dear. 
The problem becomes one of mapping a 
fuzzy model on to an explicit set o f instruc- 
tions in the simulated system (Figure 1(b)). 

By recognizing that the simulated world is 
a different world by virtue of the control 
mechanisms, structuring the iconic inter- 
face to provide consistent control mecha- 
nisms eases the task of learning a new 
mental model for control. While the ideal 
situation is to make the machine 'invisible' 
(Norman, 1987, Hollan 1984), there is still 
control of the device. 

Graphic Interaction 

Graphic display has long been used as a 
powerful tool, particularly in simulation 
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Control Structures 

Icon interfaces like the Macintosh offer a 
variety of control mechanisms - pull down 
menus, buttons and superimposed win- 
dows, which can isolate foreign (to hu- 
mans) control structures in a standard way, 
separating them from domain knowledge, 
thus differentiating the levels of activity 
required to interface with the simulated 
system. 

Domain control must be made explicit in 
the simulated system. In the domain stud- 
ied, teaching problem solving tasks in a 
restricted environment, the following 
strategy has been adopted: 

1. control within tasks is by using pull 
down menus which are only visible 
when required (Figure 2); 

2. display of a completed solution is by 
using buttons displayed on the screen 
(Figure 3), 
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3. superimposed windows are used for 
displaying text for proving guidance to 
students attempting solution of a task 
(Figure 4). 

Control is a function which exploits left 
brain activity and while menu selection is 
not sequential, it does provide a linear 
approach. Button selection gives access to 
a sequence of steps, and keeping graphic 
and text windows separate is consistent 
with the approach adopted for the Macin- 
tosh system interface. 

There is at best a fuzzy mapping from the 
simulated world for control functions. This 
creates problems for the user who must 
form a mental model of control structures. 
However, separating them from domain 
knowledge by a completely different form 
of interaction with the computer system 
provides a clearly defined method of dif- 
ferentiating between control of the ta sk and 
manipulating objects within the domain. 
Byaligning these differentlevelsof activity 
with a mapping most suited to left brain/ 
rigfrt brain functioning (Edwaids, 1979), 
the user, whether they be the specialist 
teacher at knowledge acquisition time, or 
the student at problem task execution time, 

can more easily form a mental model of the 
system. 

Control features provided by the interface 
are available only when required. Pull 
down menus are only visible when a par- 
ticular command is required and buttons 
and superimposed windows are sent away 
when they have been used. This provides 
minimum interruption to the thought pat- 
terns required to solve the task within the 
domain. 

Conclusion 

If the transformation from the specialists 
mind to the system is aided by an interface 
which is closer to the human specialists 
view of the problem than the system inter- 



pretation, it seems likely that the acquisi- 
tion of knowledge both in quality and 
quantity, is enhanced. This knowledge 
acquisition tool attempts to shift the inter- 
face to the human end of the spectrum by 
making use of input techniques which 
reduce the 'visibility' of the machine. Hol- 
lan (1984) maintains that the design of an 
interface should be considered as the con- 
struction of a representational system for 
communication. 

Further exploitation of the iconic interface 
provided by the Macintosh should lead to 
better understanding of the formation of 
mental models by different classes of users. 
Differentiation between control structures 
and domain activities at the Macintosh 
interface provide an effective means for 
improving formation of mental models. 
Adopting a structured approach to the use 
of an iconic interface for knowledge acqui- 
sition can also reduce the time taken to 
become at ease within the authoring envi- 
ronment. 
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— Intelligent feedback In CAL 
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Much of the value of Computer Aided Learning 
stems from its interactive nature, its ability to 
elicit from the learner a thoughtful response to a 
question; it is the very next step that is often 
under-exploited The computer's reaction to the 
learner's response can contribute a great deal to 
theiearning that is going on. If we simply tell the 
learner mat the answer is right or wrong (or, at 
moat, congratulate or commiserate), then we fail 
to take advantage of the receptive state that has 
but induced in the learner by the concentration 
needed to construct that answer. The repertoire 
of skills used by skilled tutors in discussion 
classes has its counterpart in CAL; maximum 
benefit can not be got until we exploit it This, in 
CAL as in a tutorial, demands both a careful 
analysis of the student's answer and a reaction 
to it which has been developed to at least the 
same standard as the body of the lesson. 



As in so many other disciplines, we work- 
ers in Computer Aided Learning are apt to 
fall into habitual ways of thinking and 
doing. It is constructive to do this to a 
controlled extent; progress would be slow 
indeed if we had to start off each new 
project from scratch and were not able to 
profit from experience, if we had always to 
'reinvent the wheel'. But, from time to 
time, we ought to scrutinise some of our 
assumptions and practices, in case condi- 
tions have shifted without our noticing, 
making those assumptions and practices 
less valid (or even completely invalid); 
perhaps we might find that we no longer 
need that wheel, but would do better with 
legs or caterpillar tracks/The field that is 
sometimes referred to as Tutorial CAL' is a 
case in point; let us use it as an example. 
There is a number of possible definitions of 
what it is (and there is considerable loose- 
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ness in their application), but for the pur- 
poses of argument I shall take that given in 
Higgins and Johns (1984), as a description 
of 'drill-and-practice' programs. It will be 
recognized as a paradigm followed by 
many CAL lesson authors (who would 
often, I am sure, vigorously deny that what 
they are doing is 'drilling'). 

Higgins and Johns list (page 39) the follow- 
ing components: 

1. select task or question 

2. display question 

3. accept student's answer 

4. match answer against acceptable 
answers) 

5. report success or failure 

6. adjust student's running score 7. return 
to(l). 

This list needs to be only slightly modified 
to make it apply more generally. Specifi- 
cally, if we widen items (1) and (2) to read: 

1. select information, stimulus material 
and/or question 

2. display information, stimulus material 
and/or question then it will cover a 
considerable number of those lessons 
which are commonly encountered. 

In this paper, I shall focus particularly on 
items (4) and (5) and suggest that it is in 
these that the greatest potential for im- 
provement resides. Sometimes, I suspect, 
attention has been almost entirely directed 
to devising stimulus material that will be 

o 
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searching and challenging, and displaying 
it in captivating ways, steps (1) and (2). I do 
not deny the value of these, merely recom- 
mend that steps (4) and especially (5) 
receive a comparable sharp of attention. 

A mathmagenic approach 

There is an extensive literature concerned 
with learning from texts, largely initiated 
during the heyday of programmed learn- 
ing, but transcending it; the newcomer will 
find Jonassen (1982) a useful starting point. 
Among the many aspects of the field, one 
referred to as mathemagenics' has a par- 
ticular relevance to CAL. The term prop- 
erly refers to those behaviours in a learner 
(originally in one engaged in working 
through a programmed text) which 'give 
birfa to learning', but has been given an 
extended currency as description of a 
domain of study in its own right. 

The central notion of mathemagenics is that 
the structure and components of a text (or, 
by extension, of a CAL lesson) can be used 
to stimulate particular mental behaviours, 
particular ways in which the text is at- 
tended to and processed by the learner: 

By controlling the way the learner thinks 
about textual material, we can determine 
how learners will convert presented infor- 
mation (nominal stimuli) into encoded in- 
formation (effective stimuli). (Jonassen, 
1982, vol l,p 220) 

The means we have of effecting this control 
lie mainly, but not entirely, in the content, 
structure and appearance of the textual 
material itself; Isaacs (1986) has written on 
the application of some of these techniques 
in CAL, particularly on the use of screen 
presentation to achieve advance organiza- 
tion and to demonstrate structure and 
emphasis. For printed text, some mathe- 
magenic aids which ha/e been used or 
proposed include: 



• questions inserted in the text (either 
'pre-questions' or 'post questions') 

• advance organizers 

• behavioural objectives 

• headings, titles and emphasis (e.g. ital- 
ics or underlining) 

• instructions about note-taking (in the 
text, or separate). (Jonassen, 1982, vol 1, 
pp 130-131) 

There is an obvious relationship between 
some of these text-based procedural de- 
vices and the parts of a tutorial CAL lesson 
that were listed before, and we should cer- 
tainly bear these in mind; but when we are 
talking about computer mediated presen- 
tation rather than about print there is an- 
other very powerful mechanism at our 
disposal, thanks to the much more interac- 
tive nature of that medium compared with 
'passive' text. 

We should certainly use mathemagenic 
techniques borrowed directly from the 
world of print, but we should also take 
advantage of the receptive state of mind 
which these techniques induce in the 
learner. At the moment when he or she has 
just answered our carefully designed ques- 
tion, we can analyse that answer and then 
immediately respond to it, giving feedback 
to him or her which is sensitive to the 
answer and the context in which it was 
given. This will have more impact than a 
stock response can ever have. 

So there are at least three phases of lesson 
design involved at each point of interaction 
with the learner 

• the construction (both in content and 
form) of the stimulus text,and of the 
task or question to be presented 

• the analysis of the learner's response 

• the feedback given as a result of that 
analysis. 

I shall not dwell in this paper on the first of 
these, since there is little difficulty in seeing 
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the relationship between established text 
techniques and their equivalents in CAL. 
However, there is not the same established 
body of knowledge and experience for the 
latter two items/which will therefore be 
addressed in some detail below. 

Evaluating responses 

A great deal of effort has been spent over 
the years in devising efficient and effective 
ways of evaluating the responses that a 
learner gives during a CAL lesson, which 
are usually (but not always) answers to 
questions. There is, as always, a trade-off; 
here it is between forced and free re- 
sponses. 

Forced responses, such as are used in mul- 
tiple choice questions or for menus, are 
easy to analyse, but limit the learners' 
activities to those of choice or recall from a 
limited set of possibilities; free responses 
leave more to the learner, but are notori- 
ously more difficult to evaluate. 

The usual compromise solution is to allow 
a certain degree of latitude in response, 
and accept the fact that some answers 
which a human would judge acceptable 
will be rejected and some unacceptable 
ones accepted by the essentially limited 
algorithms that are practicable (in terms 
of programming complexity, processor 
time, memory or disk space, and so on). 

But there is another underlying (and more 
important, to my view) aspect of the ap- 
proach to evaluation which will bear some 
scrutiny. For both closed and open re- 
sponse sets, answer evaluation in the bulk 
of CAL lessons in service has been imple- 
mented in terms of 'matching', meaning 
that a learner's answer is compared with a 
set of stored expected patterns, some cor- 
rect, some incorrect; this, indeed, was an 
explicit component of the drill-and-prac- 
tice example quoted earlier. The learner's 
score and the subsequent course of the les- 



son depends on whether a match was 
made, and what it was. .1 prefer to think 
more broadly, of classification rather than 
of matching. 

The central concept of matching is that of 
selecting a small number of predetermined 
patterns from a large population of pos- 
sible ones, and subsequently winnowing 
out 'correcf from 'incorrect 7 . To be sure, 
thisisa formof classification, but if weset 
out with the idea of classification as the 
primary one, it seems to me that we are at 
liberty to choose our categories in a freer, 
less encumbered way than mere matching 
will allow. If we start with the idea of 
matching, then we can implement certain 
restricted forms of classification; but if we 
start with classification, then matching is 
but one of the many options available to us 
(and may sometimes, indeed, be appropri- 
ate). 

It would be, perhaps, a little fanciful to 
claim that what we are attempting here 
amounts to introducing a higher order 
cognitive skill to our programs (in the same 
sense that we think of analysis as a higher- 
order skill than recognition when we are 
discussing human learning); to do this to 
any extent would take us into the area of 
artificial intelligence, and I am not intrepid 
enough an explorer to venture as far my- 
self; pioneering work is proceeding else- 
where, in several fascinating directions. 
However, even the move from matching io 
classification as our basic model will, I 
think, have a significant influence on the 
design of lessons, and even ^nore impor- 
tantly on the design of autht ;;ng tools 
(programs or languages designed to assist 
the 'courseware author') and, in the long 
run, on computer-based management 
systems. 

As illustration; some present authoring 
systems stipulate that a certain set of con- 
sequences must invariably follow a 'cor- 
recf response, another set must follow an 
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'incorrect' one; no provision is made for 
any other case. Or, in a more specific in- 
stance, some packages insist that a learner 
be given all the marks for a right answer 
and none of them for a wrong one, thus 
effectively ruling out answers of interme- 
diate merit. These sorts of restrictions can 
be frustrating to someone trying to write 
lessons intended to exercise learners' 
higher-order skills; they exert a similarly 
damaging but subtle influence on the field 
of CAL as a whole. 

Perhaps, in CAL, it would be better to re- 
place the rigftt/wrong duality by a con- 
tinuous spectrum which ranges from 'ex- 
cellent* down to 'awful', even if this does 
have to be implemented in practice as a set 
of disjoint categories, I still remember 
being told, thirty years ago when an engi- 
neering student, that in engineering there 
are no right and wrong answers, just good 
and bad ones; this is true of more fields than 
engineering. 

We have been talking of 'tutorial' CAL; a 
term which, presumably, is intended to 
suggest that there is some relationship 
between the activities in the CAL lesson 
and what normally goes on in a conven- 
tional class conducted by a tutor. One of the 
desirable characteristics of a human tutor 
(as well as those of being knowledgeable 
and skilful) is that he or she listens to his or 
her students and responds sensitively; it is 
this behaviour that we ought to be trying to 
simulate here. Just as I am accustomed in 
my work as a staff developer to running 
workshops intended to enhance the listen- 
ing and communicating skills of tutors, I 
would like in this paper to advocate that we 
enhance the corresponding 'skills' of CAL 
lessons. 

A tutor who is listening with sensitivity can 
do much more than determine which an- 
swers are right and which wrong; he or she 
can detect subtleties and, with experience, 
diagnose mistakes in reasoning and defi- 



cits in prior knowledge. There ought to be 
similar benefits in the refinement of classi- 
fication that we are discussing here. 

Once a approach based on classification 
has been adopted, there are several tasks to 
be undertaken at each point in the lesson at 
which the learner gives a response: 

• constructing a set of meaningful catego- 
ries and specifying program paths or 
reactions to each of these 

• deciding on the criteria by which re- 
sponses will be sorted into those cate- 
gories 

• designing algorithms by which the cri- 
teria will be tested 

• checking the algorithms against test 
data; responses generated either by the 
lesson author or, preferably, by a pilot 
group of learners who have similar 
characteristics to the 'target audience' 

• developing categories, paths, criteria 
and algorithms in an iterative way. 

The criteria for classification mentioned 
here, and the algorithms by which they are 
implemented, should be developed to an 
appropriate level of sophistication, where 
'appropriate' is the key word. It is just as 
ineffective to waste resources and effort in 
using refined techniques to make gross 
decisions as it is frustrating to try to make 
subtle discriminations with too coarse a 
sieve. 

(Note also that the development process 
referred to in the last item in this list is not 
a substitute for that wh'ch takes place (one 
would hope) during the production of any 
new learning material, but is contained 
within it.) 

It was not by chance that I included two 
distinct activities in the first item in the list. 
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The processes of deciding on. categories 
and on the differential behaviour of the 
program (lesson) in respect of these catego- 
ries are intimately linked. One might use 
here an analogy borrowed from medicine; 
a medical researcher who wishes to deter- 
mine the aetiology of a patient's condition 
may use different tests from that of tK 
clinician who wishes to make a diagnosis 
for the purposes of planning treatment In 
the same way, we must be clear to make the 
distinction between those questions which 
are appropriate for assessing a learner's 
state of knowledge and ability and those 
which will enable us as teachers to best 
facilitate his or her learning. I am not saying 
that thereis never an overlap between these 
two sets. 

Intelligent feedback 

I have made the point in an earlier paper 
(Foster, 1986) that there are occasions on 
which we may wish not to respond to a 
learner's answer at all and others on which 
a brief response is all that is warranted. I 
claim here, however, that as a general rule, 
if we fail to exploit the opportunity of r> 
sponding fully, then we are missing a 
chance to enhance significantly the very 
learning that we are trying to induce. After 
all, the learner has just been deeply in- 
volved in constructing the best answer that 
he or she can, and his or her attention is 
likely to be tuned to a fine pitch. We are 
poised at the legendary 'psychological 
momenf. 

A well designed response, moreover, 
should act as a powerful motivational rein- 
forcer; if the learners think they are being 
'taken seriously' they are less likely to be 
turned off than if they gradually get tba 
feeling that, however hard they try, the 
computer response is going to be a laconic 
"correct" (or even worse a patronising 
"Well done, Johnny!"). 

At the very least, the response should ac- 
knowledge the learner's answer by echoing 



it (or better, paraphrasing it) so that he or 
she can see that 'the computer has heard 
and understood if. After that, the learner 
could be given reinforcing or correcting 
information, which could in its most ele- 
mentary form be the words "right" or 
"wrong", but would be better if elaborated 
appropriately. ITiis might be followed by 
new information, designed to consolidate 
or expand on the textual material which 
preceded the question just answered. 

The point at which the 'response' ends and 
the next part of the program or lesson be- 
gins is somewhat undefined; we could 
choose to say that all material which is 
sensitive to the learner's «most recent an- 
swer is part of the response, but this would 
only be the case when the subsequent route 
through the lesson is fixed; h, 'ally this 
would also depend on the learner's 'an- 
swering history'. In any case, it is more 
important to include all the features here 
described than to attribute them to particu- 
lar functions of the underlying software. 

I have said in the p receding section that it 
should be our aim to emulate the sensitive 
and knowledgeable tutor in the behaviour 
of our programs when they respond to a 
student's answer. One of the components 
of sensitivity, as I have mentioned, is the 
ability to listen; the CAL equivalent of this 
resides in the operation of the procedures 
used for evaluating, for classifying re- 
sponses into categories. The CAL analogue 
of knowledgeability in a tutor is embodied 
in the prior definition of the categories and 
in the design of the algorithms which per- 
form the classification (here again it is dif- 
ficult, and of little point, to distinguish 
absolutely between these two). 

Another component of sensitivity is empa- 
thy; the nearest equivalent of this in a CAL 
system is in the extent to which the pro- 
gram as a whole is designed to suit the 
target audience and, on a more local scale, 
the extent to which it can respond to what 
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it Tcnows' about the learner; the history of 
previous answers and interactions earlier 
in the session and, maybe, in other sessions. 
As a concrete example: if a student has 
already demonstrated his or her knowl- 
edge of a fact, we would not consider it 
tactful if a tutor were to carefully explain 
the fact to him or her at a later time; in a like 
manner this should be an elementary re- 
quirement of all CAL software. 

Remarks on implementation 

I have recommended a move away from 
matching algorithms toward something 
more general. This was not simply an ex- 
pression of faith; there have been develop- 
ments in computing going on outside the 
CAL field, brought about by the revolution 
in computer use in office practice, that it 
would be remiss of us to ignore. (As well, as 
I have mentioned, as some valuable re- 
search aimed specifically at CAL; I am sure 
we shall see evidence of this work else- 
where in these proceedings.) 

It 3 commonplace, now, to find on-line 
spelling checkers and thesauruses ('the- 
sauri?) available as accessories for word 
processing packages used on personal 
computers in offices. The thesaurus, in 
particular, offers features very close to 
what would be needed for intelligent clas- 
sification of learner responses; and both 
these types of auxiliary programs have 
been developed to the point at which it is 
possible for them to process each word as it 
is typed inby the user in 'real time', without 
serious delays (especially as learners will 
be unlikely to be typing as fast as clerical 
staff). 

What the thesaurus does now is very close 
to what would be required of answer clas- 
sification algorithms; it is capable of taking 
a target word and associating it with a list of 
synonyms, close relatives and antonyms. 
The same type of coding techniques can 
equally be used to associate an answer with 



the appropriate one of a number of re- 
sponse categories predefined by the lesson 
author. Further; just as in an office the the- 
saurus to be used on any given occasion, or 
the dictionary used for spelling checks, are 
selected fron a small number of standard 
versions, so the same generalization can be 
applied to answer evaluation. One might 
envisage having an answer thesaurus for 
psychology and a different one for political 
science; certainly it would be impracticable 
to construct a new one for every new 
course, and ludicrous to do it for each new 
lesson. 

The other technique that has been develop- 
ing quietly outside the CAL world is that of 
so-called 'natural language interfaces', 
mainly for use with database packages. Just 
as with thesauruses and spelling checkers, 
extremely keen competition has stimulated 
advances in this field that are equally wor- 
thy of consideration by CAL workers. Why 
should the lesson author be compelled to 
construct complex logical expressions 
(CSPAIN' OR TORTUGAL') AND NOT 
(ITALY' OR TRANCE')), while his or her 
colleague m business is benefiting from 
much more sophisticated and easily used 
techniques? 

When we turn to the question of providing 
feedback to the learner, there is no similar 
advance in computational technique that 
springs to mind; the requirei mts here are 
very similar to those needed for presenta- 
tion of the primary information in the les- 
son. So, as in that case, we should simply 
make sure that we are not overlooking any 
ways of making the content and presenta- 
tion of the text as effective as possible; here 
we are using the corpus of expertise of the 
technology of text directly. However, it is 
worthwnile, even at this stage, asking the 
fundamental question which T raised in 
Foster (1984); should we be using the com- 
puter exclusively to present this informa- 
tion, or should we also rely on supplemen- 
tal material, even on print material, using 
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. the computer to manage this information 
| v rather than to present it? 

*\ Conclusion 

i 

l What Ihaveattempted to do in thispaper is 
| to make two major points; the first is that 
P Computer Aided Learninghas a distinctive 
& strength, compared with some other media 
|| of teaching and learning, in that it is inter- 
f active, and therefore uniquely capable of 
'f demanding thinking and reasoning from 
I? the learner. I followed this with some sug- 
^ gestionsasto how best to exploit a partial- 
is lar aspect of this quality, which we could 
k sum up in the aphorism "strike while the 
f : iron is hot". 

( The second point made and elaborated is 
j that we might try to emulate that quality of 
* ef fectiv » tutors which we refer to as sensi- 
; tivity, and add it to the equivalents of 
I knowledge and skill that, presumably, we 
: have always tried to incorporate into our 
CAL lessons. This might be done, on the 
one hand, by paying attention to ways of 
evaluatingstudentarawersthatgobeyond 
mere matching or identification with pre- 
defined models; on the other by putting as 
much effort and ingenuity into construct- 
ing truly helpful feedback to students as we 
have always done in devising rich text and 
searching questions. 

Implicit in these suggestions is a further 
technical one; that we should not fail to take 
advantage of computational techniques 
developed for other purposes; such as the 
on-line spelling checker, the thesaurus and 
the natural language interface. 

There are many exciting developments 
which are only just over the horizon of the 
CAL world; my proposals here may be 
more modest in scope than some which will 
be considered commonplace in the future, 
but I hope they have their place and that 
they might offer a lasting benefit 
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The leading edge of AI research in CAL is 
mainly concerned with problems of represent* 
fog knowledge, modelling students' knowl- 
edge, processing natural language, and intelli- 
gent choice of teaching strategies. It will be 
some years before this research becomes eco- 
nomically and educationally viable. 

Meanwhile, there are many aspects of CAL that 
can benefit from piecemeal application of AI 
techniques, without attempting to resolve the 
above-mentioned difficult problems. The au- 
thor is currently implementing a system where 
AI technique* <uC applied to a conventional 
CAL system, to select suitable material for de- 
livery to the student This was described in 
(Harris, 1985). This paper considers another 
area where such techniques could be applied, 
namely Authoring Systems. 

The Lazy Person's Technique. 

In (Harris 1985) I suggested that a consider- 
able lime would elapse before a full, "intel- 
ligent" CAL system would be truly user- 
friendly, affordable, and acceptable to 
teachers and students as a viable teaching/ 
tutoring alternative to human teaching. 

Meanwhile, however, it is clear that tech- 
niques imported from AI systems can be 
applied in a somewhat piecemeal fashion 
to various aspects of a CAL system, with 
useful and effective results. Such systems 
are exemplified in (Webb, 1984,1985) and 
(Harris, 1985). 

Students learning computer science are 
taught the technique of Top-Down Decom- 
position of problems. This means, simply, 
breaking a problem down into ever smaller 



problems, until the level of decomposition 
is such that each sub-problem is easy to 
handle. 

Another aspect of this technique is that it 
allows one to consider the problem at a 
high and very general level first, before 
considering the details. 

Putting this another way, Top-Do wn De- 
composition allows one to dodge the nasty 
bits and concentrate on the interesting 
parts. One might, indeed, say that it en- 
courages one to put off till tomorrow what 
one does not feel like doing today! That is 
why I call it a lazy person's technique! 

I mention this because I believe that what- 
ever comprises CAL can be broken down 
into a bundle of sub-tasks or sub-problems, 
to each of which some AI techniques may 
be applicable and effective. 

By identifying those sub-tasks where AI 
can be used, and deferring attempts to 
apply AI to those tasks which are currently 
intractable, we are likely to make more 
rapid progress in CAL than would be the 
case if we were to try to tackle the whole 
problem headon. Among the intractable 
tasks I include: understanding natural lan- 
guage, in speech and writing; generating a 
complete lesson from a subject domain 
knowledge base; effectively representing a 
student's knowledge of the domain; and 
other difficult tasks like these. 

This is not to say that the "headon" ap- 
proach should not be attempted, nor that 
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the difficult tasks should be neglected: 
these are precisely the areas where 
well.funded research needs to done. But 
while others tackle the hard parts, educa- 
tors are anxious to "get on with it*. So let's 
help them by hying to improve the CAL 
techniques we now have, in those areas 
where improvement, via AI, is currently 
feasible. It was in this spirit that I proposed 
the PSICAT system (Harris, 1985), now 
under development, where AI techniques 
were applied to the problem of selecting 
conventional CAL material appropriate to 
the student's current progress record. 

In this paper I want to consider yet another 
sub-task of CAL where I believe AI could 
usefully be applied, namely, Authoring 
Systems. 

Achieving flexibility in an Authoring 
System. 

In (Harris, 1983) I described the features 
which I thenbelieved an Authoring System 
should contain. That paper was written 
before I fully realised that, for CAL to prog- 
ress, AI must somehow be involved. Cer- 
tainly the kind of flexibility and the facili- 
ties I advocated then, are still highly desir- 
able. However, I hope to show here that 
much of that flexibility can be provided 
automatically by the built-in expertise of an 
Al-based Authoring System (AIBAS). In 
order to show this, it is first necessary to 
analyse and decompose the necessary fea- 
tures of a good Authoring System. 

What an Authoring System should be 
like. 

There are essentially three kinds of people 
who whose interes are affected by an 
Authoring System: 

• the teacher, in the role of educator; 

• the teacher, in the role of lesson author; 



the student, in the role of learner. 
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I shall refer to these roles as "educator", 
"author", and "student" respectively. 

The needs of the educator: teaching 
style. 

The educator requires pedagogic flexibil- 
ity. By this, I mean that the lesson, or rather, 
the Authoring System that is used to pro- 
duce the lesson, should support many 
pedagogical styles and a mixture of styles. 

Styles would include "browsing" - an un- 
structured presentation of material giving 
the student free choice in the selection of 
material; structured or hierarchical organi- 
sation of material; and others. 

A fully intelligent system would include a 
knowledge base of criteria which would 
enable it to dedde upon which pedagogical 
style or styles it should use for a given 
lesson or lesson segment presentation. 

In (Harris, 1985) I have described a system 
(PSICAT since renamed "ICATS") which 
presents a lesson composed of hierarchi- 
cally organised lesson-segments, selected 
according to the student's performance 
record. I shall not discuss this particular 
aspect of AIBAS further in this paper. In the 
light of my opening remarks, I also do not 
intend to pursue the problem of establish- 
ing a system that can make its own deci- 
sions about style. 

Rather, I would propose a system that can 
advise the educator on the appropriate 
style of presentation, leaving the final 
choice to the educator. This would be, in 
other words, an advisory Expert System - a 
sort of "Educator's Style Adviser". This 
puts the intelligent Authoring System well 
within the capabilities of currently avail- 
able Expert Systems. 

So the Educator's Style Adviser would in- 
terrogate the educator to find out what s/ 
he has in mind for II lesson, in terms of the 
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nature and structure of the content, and 
provide advice accordingly. 

The needs of the author - Jiardware. 

The distinction between the needs of the 
author and of the educator is somewhat ar- 
tificial, but useful for establishing further 
areas where AI can be effectively applied. 

The Authoring System must be capable of 
generating different kinds of presentation - 
text, graphics, colour, sound, simulation, 
and animation, and mixtures thereof; it 
must be able to control external devices 
such as video disc and tape machines, tape 
recorders, and slide projectors; and it must 
be capable of activating and interacting 
with other programs available on the com- 
puter, such as language compilers and 
command shells. 

Seen from this point of view, an intelligent 
Authoring System needs to have a knowl- 
edge base with extensive information 
about the characteristics of various hard- 
ware devices and how to use them. 

Assume that the result of the consultation 
with the Educator's Style Adviser is that 
the author has chosen the appropriate 
style, and that the Educator'sStyle Adviser 
has used this information to select another 
Expert System that can deal with the par- 
ticular choices made. I shall call this system 
the "Author's Assistant". 

The author now has to embark upon the 
task of creating the actual lesson, or lesson 
segments. 

Authoring a lesson. 

The Author's Assistant would be a single, 
self contained Expert System whose 
knowledge components (rules, facts, etc) 
are marked to indicate whether they are 
appropriate for the choices made at the 
Educator's Style Adviser stage. Only items 



which are appropriate are used by the 
Author's Assistant. 

The Author's Assistant would be con- 
cerned with such things as screen layout, 
editing of text, graphics, and sound, the 
control and interaction of external devices, 
the nature of interaction between student 
and segment, and the manner in which 
student input should be evaluated. 

Handling text screens. 

Since the Author's Assistant is to behave as 
an expert, it should interact with the author 
at a high level, rather than require the au- 
thor to provide detailed layouts, etc. 

For example, the Authoring System would 
require the author to indicate what should 
be shown on the screen; say: text, a ques- 
tion, and a response. I would not expect the 
system to accept natural language input 
from the author: that is one of those areas of 
AI which I want to place, for a while, in the 
"too hard basket", and leave to the leading 
edge AI researchers! I would be content 
with a menu-based dialogue! 

The Authoring System would then call for 
more information: i.e it would ask the au- 
thor to enter the text, and automatically 
invoke a screen-based text editor (with 
plenty of on-screen help!) for the input. 
When the input is complete, the Authoring 
System knows exactly how much text there 
is. At this stage the Authoring System 
might ask the author to use the cursor to 
indicate where words should be high- 
lighted or coloured. It then calls for the 
question, using the same text editor, and 
the style of question such as multiple 
choice, or text string (if not already estab- 
lished by the Educator's Style Adviser) and 
displays a provisional screen layout as it 
would be seen by the student. 

A weakness with many non-AI Authoring 
Systems, and a difficulty for the author, is 
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that the s/he has to supply pattern strings 
for matching against student answers. An 
AIBAS should generate such strings auto- 
matically. The system might use a combi- 
nation of methods: "soundex", dictionary 
look-up (suitable techniques might be 
gleaned from currently available spelling 
checkers), transposition of characters, and 
soon. 

Grammatical analysis of student input is 
more difficult for an AIBAS in the last 
analysis it is a natural language under- 
standing problem, to be lazily filed away in 
the aforementioned too-hard basket! 
However, if we wish to deal with a re- 
stricted subset of natural language, or with 
a well defined programming language, for 
example, the Authoring System should 
provide facilities for syntactic definition. 

Perhaps the Authoring System could pro- 
vide two facilities: a means of defining a 
''complete" definition for the language in 
question, and a means of defining a syntax 
associated only with a particular answer. 
Thelatter seems more attractive for the lazy 
Authoring System, and is probably easier 
for the author to handle: I would expect the 
Authoring System to ask for lists of words, 
their associated grammatical categories, 
and a syntax description limited to the al- 
lowable structure of the answer currently 
being processed. This, combined with the 
techniques for pattern matching suggested 
in the previous paragraph, would enable 
the Authoring System to generate all the 
testing needed to evaluate textual student 
responses. 

Handling graphics 

Designing aesthetic and legible graphics is 
an expert job. Itshould therefore be done by 
an Expert System. It is, perhaps, again a too 
hard task to develop such a system. 

On the other hand, the lazy Al-er should 
apply her/ himself to the design of a 
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Graphics Editor with an intelligent ability 
to create graphics from theauthor / s replies 
to questions. To avoid excessive complex- 
ity, the Graphics Editor should develop a 
display by a process of trial and error, refin- 
ing its questions to the author and the 
graphics generated in response, until the 
author is satisfied with the result. 

Handling other devices. 

I do not profess to know a great deal about 
videos, tape drives, and the like, so I do not 
want to comment on this aspect in any 
detail. 

Let it suffice to say that the principles on 
which the preceding discussion is based 
can be applied here too, with Editors and 
Expert Systems providing advice and, if 
necessary, generating appropriate proce- 
dures. 

Some aspects of software design. 

The Expert Systems proposed here would 
need, in their knowledge bases, not only 
rules and facts, but also procedures. These 
would be very high-level procedures 
which the Expert system would condition 
or parameterise, to produce the demon- 
stration layouts, text screens, response 
evaluations, graphics etc. 

These same procedures would, of course, 
form part of the final AIBAS system that 
interacts with the student. 

The needs of the student. 

It is a general requirement of CAL, whether 
Al-based or not, that system must respond 
quickly, provide help, perhaps allow user 
friendly consultation of databases, be gen- 
erally easy to use and easy to see. 

Other desirable qualities include some, at 
least, freedom of choice (which may, per- 
haps, be an option specified by the author) 
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of material, ability to terminate a session 
and resume from the last point of exit, and, 
especially, adaptation to the particular 
student. This latter aspect is addressed in 
(Harris, 1985). 

Conclusion: MB AS is possible now. 

By now it must, I hope, be dear that existing 
and proven AI techniques, especially Ex- 
pert Systems, not only can, but must be 
used in CAL Authoring Systems. 

It should also be clear that there is an order 
of priority of applica A 3on of Expert Systems 
techniques, starting with the easiest appli- 
cation first That order is, I believe; 

1. the Author's Assistant; 

2. the Graphics Editor; 

3. the Educator's Style Adviser; 

4. the rest! 

The above order is probably the complete 
inverse of that which the leading edge AI 
researchers would assert. The point is that 
my suggestions are feasible and would be 
commercially and educationally viable 
within the current state of the art. 
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Teaching Introductory Programming using a 
language-intelligent programming 
environment 
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The teaching of introductory programming 
normally involves teaching not only an ap- 
proach to problem solving and the language 
itself but also an editor and some operating 
system commands. Learning to use the editor 
and the operating system has little to do with 
learning how to program but often causes prob- 
lems because of lack of keyboard skills. Lan- 
guage-intelligent development tools are avail- 
able to aid program coding and mis paper de- 
scribes the author's experience using the pro- 
gramming environment ALICE to teach Pascal 
to first year undergraduates. 



When teaching introductory program- 
ming, no matter which language is being 
used as the vehicle, there are a number of 
factors apart from language that must be 
taken into account Firstly, there is the 
method used to describe die algorithms, 
secondly the computer and therefore the 
operating system under which programs 
are to be run, and finally/ the editor which 
is to be used to create programs. The pro- 
gram development process using the 
above approach is shown in Figure 1 . 

One problem encountered by first time 
users is slow input due to lack of keyboard 
skills, and in addition to this there is the 
need to switch between the various utili- 
ties, invoking them using operating system 
commands. 

Becomingcompetent at usin<* these utilities 
and gaining keyboard skihs may well be 
valuable in themselves, but certainly have 
nothing to do with developing problem 
solving and programming abilities. 
O 



Various systems have been developed 
aimed at integrating such utilities. These 
systems include BASIC, UCSD Pascal and 
Turbo Pascal. All of them provide an oper- 
ating environment which is menu driven 
and allows access to the file system. In each 
case, the editor is easy to use and switching 
between the utilities causes few difficulties. 
BASIC systems normally contain an inter- 
preter and syntax errors are detected at run 
time and in the case of BASICA on an IBM- 
PC, the line containing the error is dis- 
played allowing it to be corrected immedi- 
ately. Both UCSD Pascal and Turbo Pascal 
contain a compiler and syntax errors are 
detected by it. In both cases, transferring to 
the editor is almost automatic and the cur- 
sor will be on the character where the syn- 
tax error was detected. Systems such as 
these have assisted learning to program, 
but in all of them the programs have to be 
entered fully every time and good key- 
board skills are still necessary. 

The programming environment ALICE 
(Looking Glass Software, 1986) was devel- 
oped to remove the drudgery of coding 
programs in Pascal, by providing a lan- 
guage intelligent editor within a full oper- 
ating environment. First year Information 
Processing students in this University were 
introduced to programming in Pascal us- 
ing ALICE, and the remainder of this paper 
evaluates its use. 

Overview of ALICE 

The ALICE system is available for IBM PC 
and compatibles, running under the oper- 
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attempt to type an illegal symbol in a place- 
holder is flagged as an error. Undeclared 
variables may be typed within statements, 
but these will then be highlighted in re- 
verse video ,and a message displayed on 
the top line of the screen. The program is 
held within main memory in a tree format. 
Each node of the tree consists of a Pascal 
construct, with corresponding descendent 
nodes. In the case of a while statement, the 
node has two subtrees, one for the condi- 
tion and one for the statement The condi- 
tion node must be a single Boolean expres- 
sion, which is represented as a tree, 
whereas the statement subtree can consist 
of a list of statements so is said to be a list 
node. Each subtree has its own subtrees, 
and so on* It is this tree structure that 
ensures that only a syntactically correct 
programs may be written. 



atingsystem MS-DOS Version 2-0or higher 
and it consists of four components: 

• the editor 

• the interpreter 

• the debugger 

• the help facility 

The editor is syntax-directed and designed 
specifically to create Pascal programs. This 
is done by providing templates for all pro- 
gram constructs. For example, a whileloop 
consists of the template 

while Condition do begin 
Statement 

end; 

whilst a var statement has the template 
var 

Name : Type 

Typing a reserved word, followed by space 
or tab, causes the template to be displayed 
on the screen. The placeholders which 
must be replaced by the programmer are 
underlined on a monochrome screen. Any 




The second component of ALICE is the 
interpreter and is used to execute the pro- 
gram held in tree format. It is at this stage 
that some semantic errors are detected, an 
example being incorrect type expression in 
a condition. 

The third component is the debugger 
which assists the programmer in detecting 
logic errors. This is done by permitting the 
program to be executed one step at a time, 
the setting of 'breakpoints' to stop execu- 
tion on a particular statement, and the 
cursor to zip through the code on the top 
half of the screen whilst the results appear 
on the lower half.In addition, there is an 
immediate mode which allows values of 
variables to be displayed at any point 
where the program has stopped. 

The final component is the help facility 
which like all of ALICE is menu driven and 
very extensive. Not only is specific help 
given on aspectsof ALICE and Pascal itself, 
but it also allows such queries as 'What can 
I type here?' and 'What was my last error?' 

As mentioned ALICE is menu driven with 
the main menu displayed across the top of 
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the screen, and the operations and theother 
menus are invoked by using function keys. 
Fl invokes the interpreter to execute the 
program continuously, and F2 to single- 
step it. Other function keys invoke differ- 
ent menus and a full list is given in the 
Appendix. 

The file menu gives access to the MS-DOS 
file system including DOS commands. A 
request to load a file causes a list of ALICE 
formatfiles to bedisplayed; these files have 
the DOS extension .AP. No other file types 
are displayed. Selection from a menu is 
made either by a single letter or using the 
cursor keys. For the more experienced 
programmer, ALICE allows some func- 
tions to be invoked with the ALT key in 
conjunction with other keys. 

Program development 

When users first start to code a Pascal pro- 
gram using the ALICE environment, they 
are presented with the template for a pro- 
gram. 

This consists of 

program Program-Name (input, 
output); 

{Comment that says what the routine 
does} 

Declarations 
begin 
Statement 
end. 

Cursor keys can be used to move the cursor 
anywhere on the template, and the Control 
Key combined with left or right arrow keys 
moves the cursor forward or backwards to 
the nearest placeholder. Provided that the 
algorithm is well specified and proper 
preparation has been carried out before 
starting to code, using ALICE is veiy 
straightforward. The cursor is positioned 
over the Trogram-Name' placeholder and 
the required name is typed; this will replace 
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the placeholder. Pressing the RETURN key 
moves the cursor to the comment line. 
Again typing a comment replaces that 
placeholder. This process is continued by 
typing in Pascal reserved words to give the 
required template, and then merely replac- 
ing the placeholder. Should typing mis- 
takes be made^nd not discovered until 
after the placeholder has been replaced, 
the** the Undo command (CONTROL-U) 
which goes back to the previous step, may 
be used; there is also a Redo command 
(CONTROL-R) which is the reverse of 
Undo. 

If procedures are being used, then typing 
the reserved word procedure gives the 
template procedure 

Proc-name (Parameter); 

{Comment that says what the routine 

does} 

Declaration 
begin 
Statement 
end; 

This can be completed in the usual way. 
Invoking the procedure by typing its name 
causes the parameter list to appear as place- 
holders. For example, the procedure with 
declaration 

procedure SUBl(var x : real ; n : 
integer); 

when invoked by typing SUB1 would pro- 
duce the template 

Subl (var x : real, n : integer); 

This removes from the programmer the 
need to remember the variable types and 
whether they are called by value or refer- 
ence. 

One further aspect is the ability of ALICE to 
determine where certain types of statement 
should go. Often programmers, particu- 
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larly those who are just learning, forget to 
declare a variable. With ALICE, any at- 
tempt to use an undeclared variable pro- 
duces a syntax error messagebut allows the 
variable to stay* At that point, typing var 
causes the corresponding template to be 
displayed in the appropriate declaration 
section and the necessary variable can be 
declared. 

On completion of coding, the interpreter is 
invoked by pressing Function Key Fl; the 
program runs until completion or until an 
error is detected. A single keystroke re- 
turns the user to the ALICE editor. 

Once a working program has been pro- 
duced it may be saved as a text file, rather 
than in ALICE tree format, and compiled 
using a compiler system such as Turbo 
Pascal, for greater efficiency. With ALICE, 
the program development may be de- 
scribed as in Figure 2. 
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Figure 2 

Difficulties encountered using ALICE 

Given the nature of the ALICE system and 
its reliance on templates, it is quite difficult 
to make changes to the program structure 
without dismantling the code to some ex- 
tent. All statements within control struc- 
tures are nested within begin and end even 
where there is a single statement following 
then else or do. This means the user has to 
be aware of which template generated the 



current begin— end block. Figure 3 shows 
section of Pascal code produced using 
ALICE templates; (a) is correct and for 
every value of NEXTSCORE, the proce- 
dure FROCESSCORE is executed, whereas 
in (b) PROCESSCORE is invoked only for 
the final value of NEXTSCORE on each 
line. 

while not eof do begin 
read (NEXTSCORE); 
if eoln then begin 

readln; 

end; 
PROCESSCORE 

end; 

(a) 



while not eof do begin 
read (NEXTSCORE); 
if eoln then begin 
readln; 
PROCESSCORE; 

end; 

end; 

(b) 



Figure 3 

It is very easy to produce (b) when (a) was 
intended, because on completion of the 
block following them, the user must move 
the cursor out of the block and press return 
in order to generate the next placeholder. 
First-time users often overlook this. 

The code resulting from ALICE can be dif- 
ficult to read because of the large number of 
begins and ends. The practice of append- 
ing a comment to an 'end' is not available 
conveniently in ALICE, as comments, 
apart from those attached in declarations, 
must appear on a line by themselves. 

Changing existing programs can cause 
some problems all of which are related to 
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l r fon ^t to which the program is Conclusions. 

held; two examples are given: 

The most noticeable difference between 

1. to move sections of code, it is necessary developing programs in ALICE and any 

t0: other environment is the amount of typing 

. . required by the user. With ALICE this is 

• select the section to be moved, and reduced considerably because of the use of 
move it to workspace (an area of mem- templates, and this usually leads to faster 

j? ory ' coding- K has extensive help files, is menu 

driven and protects the user with such 

• select the section again and delete it prompts as Your file has not been saved', 

givingtheoption to returnto ALICE tosave 

• movetoecursortothepositiontowhich it Being language intelligent, syntax errors 
the code is to be moved, and retrieve it and type compatibility errors are detected 
from the workspace. as they occur albwing immediate correc- 

. _ tion - This lulls the first users and some 

£. to edit an arithmetic expression or an experie-iced ones into a sense of compla- 

ldentifier, it is necessary to select it and cency, to the extent where a number do not 

invoke the edit function. This could bother to learn Pascal syntax rules. It is 

involve three key strokes. interesting to note that most Pascal pro- 

„ . grammers who have learnt in a more tradi- 

tox obvious reasons, one function that tional environment do not like ALICE at 

ALICE cannot perform is to create data files first. They complain it is restrictive and 

directly at the keyboard. This means that if difficult to use, although the majority even- 

a file processing program is to be written, tually accept it has much to offer, 
then it is necessary to write programs 

which will create the data files to be proc- Its "^j 01 advantage is that it allows proc- 
essed. From a teaching point of view this Iem solving techniques to be learnt inde- 
could be seen as an advantage, but with Pendently of both the operating system 
first time users it can cause confusion, par- and the coding process. The latter process 
ticularly as programs must also be written 18 relegated to its rightful position which is 
to display these files. merely as a means of getting the algorithm 

into the computer. 

A minor problem is that a program in tree v 

format when saved in a file cannot be dis- . m Pregrem development point of 

played except by the ALICE system. If View ' most important process is the 

mere is a machine malfunction it causes the desi S n . of the algorithm. In the course ■ 

program to be stored incorrectly, then the J Ught in this ^hool, Nassi— Shneiderman 

whole program is lost. ALICE does not dia 8 rams . (Nassi & Shneiderman,1973) are 

provide automatic backup. u . sed ' "^"h/ to impose discipline on algo- 
rithm design. From these diagrams, the 

Programs may be stored as text files and ?^ uired P rocedures an d variables, both 

subsequently recovered from within AL- and S lobaL he easily identified 

ICEusingthe text to tree format conversion an , d from that P oln t coding using ALICE is 

program called APIN. This program is re,atlvelv straightforward, 

invoked automatically for a program file „ , 

with extension .PAS, but unfortunately the Re f erences 

user must remember the file name as it will T , . „, 

not be displayed by any ALICE menu Looking Glass Software (1986). ALICE : The 

Personal Pascal User Guiae. Toronto: 
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Building a knowledge base in practice in- 
structs the student, in more than the do- 
main-specific knowledge which may form 
its contents. Conceptual modelling is in- 
structionally activein the culturally signifi- 
cant area of the construction of knowledge, at 
a level at once distinct from and inclusive of 
ihe transmission of contained knowledge. The 
powerful ideas of educational knowledge- 
engineering thus have to do with practical 
epistemology. 

Powerful ideas 

With the usual genuflection in Paperf s 
direction (1980), powerful ideas are educa- 
tive ideas: they emerge from simple, con- 
crete experience to become generalisable 
and applicable in contexts far removed 
from their original circumstances 
(Yazdani, 1984a). They are characterised 
by a quality of personal enablement. The 
power of the ideas, in cognitive terms, lies 
in the way they form the basis for assimila- 
tion of knowledge. Hence, in a well-known 
passage from Mindstorms: 

Slowly I began to formulate what I 
still consider the fundamental fact of 
learning: Anything is easy if you can 
assimilate it to your (mental) collec- 
tion of models. If you can't, anything 
can be painfully difficult... .The 
understanding of learning must be 
genetic. It must refer to the genesis of 
knowledge. What an individual can 
learn, and how he learns it, depends 



on what models he has a vailable. This 
raises, recursively, the question of 
how he learned these models. Thus 
the 'Taws of learning" must be about 
how intellectual structures grow out 
of one another, and about how, in the 
process, they acquire both logical and 
emotional form. (Papert, 1980, p. vii) 

At the risk of pointing out what has been 
looked at many times, it is notable that 
Papert doesn't simply say 'learning is 
genetic". It is the understanding of learning 
that is genetic. The power of powerful ideas 
has a metacognitive foundation: they have 
something to do with the consciousness of 
a construction to acquired knowledge, and 
with the corresponding consciousness of 
there being a process to that construction. 

The powerful idea 

All of this is by way of introduction to what 
strikes me as the "powerful idea" in knowl- 
edge-engineering, a commercial and prod- 
uct orientated technology of elicitation, 
representation and machine-acquisition of 
knowledge. The idea is simple: one learns 
by developing and modelling one's con- 
ceptual structures in a knowledge-based 
system which performs the role of an inter- 
active, reconstructable medium. In effect, 
the medium plays the student. 

Using the technology of knowledge-engi- 
neering to build knowledge-based systems 
isa process which can educate the builders. 
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Feigenbaum (1984) has commented that 

In the end it may be irrelevant that a 
computer program is available to be an 
"intelligent assistant" The gain to 
human knowledge by making explicit 
the heuristics of a discipline will per- 
haps be the most important contribu- 
tion of the knowledge-based systems 
approach, (p. 50) 

Knowledge-engineering has developed as 
a commercial application of artificial intel- 
ligence (AI). The interesting point is that it 
has frequently resulted in a learning benefit 
for those involved. An extension and 
modification of human expert knowledge/ 
and more efficient industrial practice are 
two examples of such a non-computer- 
based and commercially significant result. 
In some cases, the knowledge-base has 
been discarded in the light of what may 
have been thought of as a side-effect, as 
Feigenbaum (above) has suggested. 

Kn. wledge engineering can have a gener- 
alised educational application, therefore, 
which can be distinguished from conven- 
tional methods of computer-assisted in- 
struction. Some researchers have touched 
on aspects of the application, mainly in 
connection with young children. For ex- 
ample, Bigum (1986) has commented: 

...the building of even very simple 
knowledge-based systems by children 
i.e. by having them make their knowl- 
edge and understandings explicit, and 
conform to the requirements of a shell, 
may provide their teachers as well as 
the children themselves with an oppor- 
tunity to expand and more importantly 
to critically question their knowledge. 

Building a knowledge-based system 
will not be important because of the 
finished product. The educational 
worth or the enterprise w^i be entirely 
located in the processes children will 



probably go through in order to con- 
struct such a system. The "finished" 
system may have a value in provoking 
other learners to reflect about their own 
understandings, but that is an inciden- 
tal plus. (p.180) 

And in the same context of primary educa- 
tion, Cumming and Abbott (1986) have 
made a case for using implementations of 
logic programming: 

...children ...can look inside (expert 
systems in micro-Prolog), make addi- 
tions and modifications and eventu- 
ally, write their own. Teachers also 
should find it easy to use and modify 
programs and write their own. So the 
range of possible educational activities 
is extremely broad. The suitability of 
micro-Prolog as a language for use by 
children and teachers, and as weH ;or 
the implementation of educational 
(expert systems) may be its single 
greatest strength from the point of 
virv/ of education, (p. 133) 

Few apart from the author and some Aus- 
tralian colleagues (Stern & Adams, 1985; 
Stern et al, 1986; Stern, 1986a, 1986b; Gild- 
ing, Stern & Forrester, 1986) have referred 
to the learning effects of the process as a 
generalised and comprehensive approach 
to teaching and learning, particularly at the 
tertiary level. Tertiary vocational and pro- 
fessional education tends to be dominated 
by what can be described as skill and 
knowledge transfer styles of instruction, 
which seems to many to be suited to me- 
chanical tutoring methods. K knowledge- 
engineering approach, however, can be 
easily integrated with standard and avail- 
able educational mateiials and instruc- 
tional methods, including continuous and 
examination-based assessment. It also rep- 
resents an interesting point of departure. 

An illustration by projection 

A simple illustration of what such a depar- 
ture may lead to can be provided in the 
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form of a projection, in conventional terti- 
ary educational methods, for example, 
students write essays and sit examinations 
to demonstrate their knowledge. In a 
knowledge-engineering approach to 
teaching and learning, students will also 
build knowledge-bases with available 
materials. The knowledge-bases will be 
examined and tested. The immediate pur- 
pose will be to have the student-built sys- 
tem demonstrate a certain requisite knowl- 
edge content. 

The process itself will have a broader, more 
important purpose. The resultant knowl- 
edge-bases will be convincing models of 
human knowledge. They will be able to be 
taken as material evidence of a human 
depth of understanding of the knowledge, 
originating in their creators. That under- 
standing will have been gained through the 
process of analysis and construction, and 
through critical examination of the ade- 
quacy of both the knowledge and its repre- 
sentation in the model. The value of the 
approach will thus inhere in processas well 
as product, and in personal learning as 
distinct from rote memorisation and recall. 

Learning as construction 

The process of building knowledge-bases 
cou.d therefore make a good teaching and 
learning method by placing students in the 
role of knowledge engineers. Connections 
can be made with important bodies of 
learning theory and application, in the 
broad context of using computers for edu- 
cation. 



learning by building these structures and 
models in an external interactive and edi- 
table medium is an extrapolation of that 
construed vist view. It is a synergistic activ- 
ity of reflection, both internally and exter- 
nally. 

Instruction could be described, particularly 
in the context of mechanical tutoring sys- 
tems, as the methods of building concep- 
tual structures in students. It includes 
strategies to bring the student's menta' 
model of knowledge into some correspon- 
dence with the machine's. The terminology 
of engineering, and of knowledge-engi- 
neering, is frequently associated with the 
instruction of people in this way. The goal 
of the activity is the communication, trans- 
fer and registration of well-defined quanti- 
ties of representable structures of knowl- 
edge. The reception of knowledge by the 
student is acknowledged and verified by 
simple recall, and other responses to ques- 
tioning requiring elementary explanation 
and demonstration facilities. The parallels 
with data-communication are obvious,as 
are the connections with the activity of 
knowledge-engine ring. 

Reversing the direction of the effort of reg- 
istration and correspondence, students 
who build models of their own knowledge 
in intelligent systems are creative instruc- 
tors of both the machine and themselves. 
This activity of instructive modelling can 
provide students with the role, insight s and 
learning experience that normally accrue to 
their teachers and other authors of course 
materials.. 



Learning can be viewed in cogidtive terms 
as fundamentally a construction process, 
whose results and whose building blocks 
are conceptual structures. Intelligent sys- 
tems which incorporate machine-learning 
have relied on this view, to model student 
behaviour during computer-assisted in- 
struction. In terms of constructive human- 
directed learning processes, however, 
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Broadening the focus of attention in 
knowledge-engineering 

The focus of attention in applying these 
ideaseducationally has to be broad enough 
to take process as well as product into ac- 
count. Bigum's comments earlier empha- 
size the process aspect, effectively freeing 
up the dependence we may feel, or want to 
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feel, on sophisticated technology. The tech- 
nology is with us, however, and there is no 
reason why the machine-based product of 
educational labours should be under- 
rated. At the tertiary level in particular this 
prospect is encouraging. 

But knowledge-engineering is a relatively 
new, commercial and product-orientated 
activity whose constituent processes and 
technology are chagrining, and are not yet 
well understood. The sole focus of com- 
mercial attention and incentive to date has 
been the development of a finished prod- 
uct. Both the processes and the product 
tend to have been regarded as proprietary. 
The focus, purpose and the concealment 
from public scrutiny of the activity tend to 
deflect attention from the human learning 
effects, and to place educational efforts to 
use the technology in the toy category. 

A recent comment (Jones, 1987) from a 
professional knowledge-engineer in a 
journal under the heading "Commercial 
AI: Expert Systems for Blood: Building a 
Business" nicely sums up the issues of 
learning benefits and proprietary silence: 

A problem for commercial clients in 
particular is that the consultant 
(knowledge engineer) gets to know a 
great deal about the customer's business. 
This drives some organisations to at- 
tempt to grow their own in-house 
groups.... The secrecy with which 
some organisations wish to surround 
their expert systems activities leads 
to. ..(a) frustration. It is often impos- 
sible to get permission to talk about 
the customer and/or the application 
to others. When embarking on an area 
like expert systems applications, it is 
pretty obvious that having good ref- 
erence sites gives added credibility 
both to the contractor and to the tech- 
nology itself. 

It is our view that endlessly talking 
about the great systems of the past 
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(MYCIN etc.) givesa misleading view 
of what is currently being achieved in 
the field. However, the number of 
case histories that are available for 
general viewing is sadly limited, (p. 
10) (my emphasis) 

A closer examination of the process, in 
educational contexts, could lead towards a 
more general application of the technol- 
ogy, as well as firmer underpinnings for its 
use in specific areas. 

The strengths (and weaknesses) of 
Intelligent Tutoring Systems 

The powerful idea of educational knowl- 
edge-engineering is an epistemological 
idea, having to do with the construction of 
knowledge. How does the process com- 
pare with tutoring systems, and their cen- 
tral idea? Yazdani & Lawler (1986) summa- 
rise the application of artificial intelligence 
in Intelligent Tutor Systems: 

ITS have a central objective of commu- 
nicating some knowledge through 
compu ter facilities which may employ 
domain-specific expertise, error 
analysis, and user modelling. Their 
user-oriented intelligence is con- 
trolled by instructional strategies 
which present (the user) with (do- 
main-specific) problems and then test 
for understanding of the knowledge, 
generally conceived of as a collection 
of methods for problen solving, as 
well as domain-specific knowledge. 

They state that the strengths of ITS derive 
from "good definition and... complete- 
ness" in the sense lhat an ITS 

will have a well articulated curriculum 
embodied in its domain expertise and 
an explicit theory of instruction repre- 
sented by its tutoring strategies. This 
completeness permits an ITS to pack- 
age existing expertise and focus on the 




r novelty, which is the use of mechani- 
st cally embodied sets of rules asa tool for 
i instruction. Because an ITS can be well 
\ defined for a given curriculum, the 
1 achievement of its goal, in principle, 
f can be unambiguously evaluated. 

\ The weaknesses of ITS "set against these 
j considerable strengths'' are, they state: 

...inadequate complexity in what the 
user knows, how the user learns new 
knowledge and what could be consid- 
ered an appropriate instructional the- 
ory for complex minds. 

In terms of the knowledge-engineering 
approach I am advocating, such weak- 
nesses are not necessarily redressed by 
increasing the internal complexity of ITS. 
The argument is that an appropriate in- 
structional theory for complex minds 
needs must take a knowledge-engineering 
approach into account, on the grounds of 
the self-constructive character of mind.. 

Making ITS more complex internally 

The attraction and challenge of an ITS is to 
get it to behave as a flexible instructor, 
sensitive to the "complexity of the instruc- 
tional situation" (Yazdani & Lawler, 1986). 
The focus is therefore on the issue of de- 
signing machine-learning and other expert 
systems internal to ITS to support this in- 
tended role. The idea that an ITS can be 
improved by incorporating several com- 
plex knowledge-bases, and "sites of intelli- 
gence" (Richards 1985, 1986), which are 
separate and distinct from the learner, and 
set in a particular relationship to the 
learner's activity, has attracted consider- 
able research interest. One feature of this 
approach, when human learning with an 
ITS is discussed, is that it is predicated 
upon the richness and complexity of ma- 
chine-learning in the student model inter- 
nal to the ITS. 
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Yazdani & Lawler (1986) take an example 
from Brown and Burton's work (1978) in 
teaching arithmetic, which requires the ITS 
to analyse and respond to "bugs" when a 
"child's logic represents a deviation from 
the standard addition algorithm". They go 
on to describe the resulting issue as follows: 

There will surely occur cases where 
the student uses representation be- 
yond the current scope of the system. 
What should the system do when it 
determines that it does not, and even 
more cannot, understand what the 
student is thinking? The systen 
should have available an extensib^ 
repertoire of representations. No sys- 
tem which is too rigid to learn should 
be called intelligent. 

They propose that the intelligence of the 
ITS, therefore, should consist in laige part 
of being able to learn by experience, rather 
than by being told - a crucial step which 
effectively begins (but of course does not 
necessarily seal) the process of removal of 
such intelligence from the direct control of 
students: 

While people learn more from experi- 
ence than from being told, for comput- 
ers the opposite is more nearly true. 
Computers can learn from experts 
today; for use in education, an ideal 
instructional system should be able to 
learn new representations applying to 
its domain of primary expertise even 
from non-experts, as when the stu- 
dents are introducing some alternative 
way of thinking - however non-stan- 
dard that way may be. 

It is central to the knowledge-engineering 
paradigm that what Yazdani & Lawler say 
should, ideally, be true: that "computers 
can learn from experts today 7 '. But it is how 
they learn which is vital. To develop an 
instructional theory for the knowledge- 
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engineering paradigm one needs to give 
students the latitude to instruct the system, 
and to exploit the system's learning capa- 
bilities in the same way that ordinarily a 
teacher might a student's. If this latitude is 
in some way reduced, by assuming for 
example that it does not exist, then of 
course the basis for the paradigm is weak- 
ened. 

Concern about the knowledge-engi- 
neering approach: it's too easy 

Since one of the components of the knowl- 
edge engineering approach is an experien- 
tial approach to learning, the real difficulty 
of accounting for the what and ihehow in the 
experiential process should not be under- 
estimated (as Yazdani & Lawler, 1986 in 
fact warn). Following this line of argument, 
it can be said of many tutoring systems that 
it is time to be suspicious when they assert 
a narrowly specific mechanism of what and 
how. 

Few would regard drill-and-practice or an 
overlay approach to student modelling as 
adequate expression of how a complex 
mind learns. But there is in Yazdani & 
Lawless arguments a demonstrable bias 
against leaving issues of instructional 
complexity of a tutoring system to the 
human using it. What a human does to the 
system can be, in a curious twist to the 
argument, derogated because a), it is too 
easy and b). one doesn't understand it 
because it is too complex. As an example of 
thisbias, here is Yazdani and Lawless criti- 
cism of learning by building a knowledge 
base: 

Knowledge based systems, with rules 
stored separately from the processes 
which use them, have proven their 
usefulness because their very lack of 
organisation permits the addition of 
new rules without reprogramming; if, 
on the other hand, the organisation 
and reorganisation of knowledge in 



the mind is the central need in effective 
education, thinking of learning as 
'adding another rule to the database' 
may be counter productive (p. 74) (ital- 
ics my emphasis) 

If adding another rule to the database is 
inadequate as a view of learning, and as an 
action has no educational significance, then 
the knowledge-engineering paradigm is 
on shaky ground indeed. But mechanical 
reductions of the learning process however 
should be recognised for what they are. It is 
not simply the mechanical addition of 
another rule that constitutes learning 
within a educational knowledge-engineer- 
ing paradigm. It is the consistency of that 
new rule in terms of the organisation and 
knowledge-representation discipline of 
the knowledge-based system that really 
matters. 

It is easy to seize upon the editability of a 
knowledge-base, and to object to it in isola- 
tion from the formal organisation, and 
therefore the testable behaviour of the 
whole. Logic, for example, has been from 
the timeof Aristotle a disciplineof building 
consistent and valid discourses. Adding 
another rule to a logic program is equiva- 
lent to adding another statement to a logi- 
cal proof. The consequences, and the sig- 
nificance of such an act, are in either case 
the same. 

The redress for the problem of a rule added 
at random lies in testing the system itself 
for adequacy and consistency. Notwith- 
standing the mystery of how a student 
learns through experience internally, we 
will have some measure of the success of 
that process if that student can bring the 
system to the required standard. To re- 
phrase Yazdani and Lawler: thinking of 
learning in this way is productive if it can be 
seen in terms oftheorganisaHon and reorgani- 
sation of knowledge in the mind. In this light, 
some of the "considerable strengths" of ITS 
can be incorporated in the knowledge- 
engineering approach: there are clear proc- 
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esses to follow, and well-defined externally 
assessable products as a result. 

Concerns about the knowledge 
engineering approach: it doesn't 
instruct 

Interest in ITS can also be fueled by con- 
cerns, often provoked by the experience of 
badly managed alternative approaches, 
about about guidance, control and instruc- 
tion* Here is the viewpoint of a critic of 
Logo usage (Cumming, 1985): 

Children left to learn in an unstruc- 
tured, do-it-yourself hands-on way 
sometimes generate for themselves 
quite bizarre mental models. In con- 
temporary writing on education there 
is a strong theme that such laid-back, 
laissez-faire approaches are to be ap- 
plauded. Partly this is an understand- 
able reaction to the worst rigidities of 
teaching machines, partly it is a ration- 
alisation in the face of the great diffi- 
culty of writing good CAL (Computer 
Assisted Learning) materials, partly it 
is a healthy affirmation of choice, rele- 
vance and motivation. But we must be 
vigilant! Encouraging children simply 
to go to it may be fashionable, but will 
for some children lead to serious mis- 
conception. We must not sidestep the 
responsibility of curriculum designer 
and teacher to choose and structure 
and guide: helping a learner build a 
good mental model is too important 
for this.(p.9) 

The concern is aggravated by empirical 
results such as these (Gentner & Stevens, 
1983); 

...all too often there is no correspon- 
dence among the conceptual model of 
the system that guided the designer, 
the system image that is presented to 
the user, the material in the instruc- 
tional manual that is taught to the user, 



and the mental models of the user. 
(p.13) 

The resulting dilemma several authors 
have described as follows: 

One wants to support a child but not 
the development of a wrong 
theory... we want to support the 
child's commitment to his authentic 
point of view and its creative applica- 
tion; at the same time we want to 
modify that view. 
(Yazdani & Lawler, 1986) 

... the central problem of humane edu- 
cation is how to instruct while respect- 
ing the self-constructing character of 
mind. (Lawler & Papert, 1986, p. 69) 

In the knowledge-engineering approach, 
the differential between human cognitive 
models of knowledge, and those repre- 
sentable in a machine can however be used 
as a dynamic of human learning. It does not 
exclude issues of human complexity, nor 
discount the useful aspects of building a 
model consistent enough to run in the 
machine. The cause for concern arises 
when one tries to bring people into line 
with machines, not the other way round. 
Papert (1980) made this point in a broader 
social context: 

Consider another example of how our 
images cf knowledge can subvert our 
sense of ourselves as intellectual 
agents. Educators sometimes hold up 
an ideal of knowledge as having the 
kind of coherence defined by formal 
logic. But theseidealsbear little resem- 
blance to the way in which most 
people experience themselves. The 
subjective experience of knowledge is 
more similar to the chaos and contro- 
versy of competing agents than to the 
certitude and orderliness of p's imply- 
ing q's. The discrepancy between our 
experience of ourselves and our ideal- 
izations of knowledge has an effect: It 
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intimidates us, it lessens the sense of 
our own competence, and it leads us 
into counter productive strategies for 
learning and thinking, (p. 192) 

It is hard to see the knowledge contained 
within an ITS as anything other than hav- 
ing the "kind of coherence defined by for- 
mal logic", irrespective of its degree of 
sophistication or complexity. Similarly, 
irrespective of the complexity or sophisti- 
cation of the strategies of instruction, the 
central irreducible objective of tutoring 
systems remains: to transfer a quantity of 
knowledge. The problem is to avoid such a 
"counter productive strategy for learning 
and thinking" and yet s*ill to guide; to 
instruct so that the learner constructs, 
rather than forcing the issue to the point of 
mechanical communication so that the 
learner remembers. 

My argument is that the best resolution of 
that problem is to be found in a serious- 
minded application of knowledge-engi- 
neering in education. We have nonethless 
to meet an important objection to com- 
puter-based learning environments in 
general, that a "model-based epistemol- 
ogy of instruction does not exist" (Yazdani 
& Lawler, 1986). It is argued in this view 
that in a modelling system there is no set of 
instructional techniques which derive their 
justification and purpose from a specific 
and empirically verifiable view of the con- 
struction of knowledge. 

The question is begged if a narrow view is 
taken of instruction, the direction of com- 
munication, and of the separate roles of 
teacher and learner. If teaching can be 
connected with learning, then there are 
many strategies available to the student 
who does the instructing of the machine. 
The knowledge-representation scheme of 
the system,and themeansof programming 
in it then connect in the answer to the 
simple question of: in what way does the 
student tell the system what to know? This 
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is related to the frequently asked question 
of: how does the system learn? The simple 
answer is of course, through what the stu- 
dent teachesit, and not necessarily through 
what it can infer from the student's behav- 
iour. 

In terms of who or what does the shaping, 
one should also consider the scope of the 
environment within which the student can 
construct things and get them to "run" 
satisfactorily. Here the image of knowl- 
edge is as a shape to an explorable space of 
"things to do". This space is a microworld: 
a bounded environment populated with 
computational objects, having some repre- 
sentational mapping to activities in the 
"real world" (Adams, 1986). 

The merits of this view include the recogni- 
tion of a hierarchical and recursive compo- 
sition to microvyorlds. The designer of such 
a world can include in it the objects and 
tools to make and to contain other worlds. 
Hence the role of designer can be trans- 
erred to the designed, or more precisely to 
the user within a designated space. Such a 
microworld, in other words, can be viewe d 
and presented as just another computa- 
tional object The concept copes with (frag- 
mentary) collections of microworlds, and 
of computational objects within worlds. 

The major weakness of a simple discovery- 
orientated learning strategy, as we have 
noted at several points in this thesis, is its 
openness to aimless wanderings. This ob- 
jection can be partially met by acknowledg- 
ing that explorations of microworld spaces 
can be directed by teachers, and by job or 
life-related requirements to do something 
specific. An example of the latter could be 
the building of industrially useful knowl- 
edge-based systems using tools within a 
knowledge-engineering environment. 

Nonetheless the apparent lack of an innate 
instructional strategy, belonging to the 
n icroworld and based on some view of 
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epistemology, is not fully dealt with by 
reference to external direction. The argu- 
ment is further weakened, in the knowl- 
edge-engineering example, by the very 
generality end scope of the working envi- 
ronment. What does one learn from a blank 
sheet of white paper, or a word-processor 
for instance? 

One must therefore look for instructional 
strategies in what the modelling environ- 
ment does to the student as an active conse- 
quence of its design and character, not 
simply in the constraints, more or less, 
placed upon him or her by external agen- 
cies or the scope of the modelling environ- 
ment To do justice to the notion of instruc- 
tion, it must come to the student . What he or 
she does, whether directed or not, should 
give back something. The reflection in the 
mirror has to teach, in other words. 

Instruction through practical 
epistemology 

A model-based system teaches something 
very concrete and specific about knowl- 
edge. Its real "instructional goal" is to 
communicate a number of personally and 
socially significant epistemological state- 
ments. These are that human knowledge is 
at once 

• representable; 

• constructed; 

• limited and 

• editable. 

It is easiest to see these communications as 
instructive when the student is given a 
knowledge-based system, for example, 
which already has some significant and 
relevant knowledge modeled within it. But 
there is also a strong basis for the argument 
in a concept-modelling shell itself, a mes- 
sage let us say, in its medium. In a sense, the 
ability to run a concept model is an instruc- 
tive and live demonstration of the answer 
to the question one frequently asks of other 
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people: how come they can think (or say) 
that? This is practical epistemology. 

Each epistemological statement has impor- 
tant repercussions in terms of our under- 
standing of the cultural and personal bases 
for knowledge, and our own views about 
how it is possible to alter knowledge, and 
hence learn. The active instructional pur- 
pose of a model-based system therefore is 
simply to make it possible to learn those 
important things about knowledge by 
building and "running" models. The point 
is at its sharpest in an interactive concept- 
modelling system. The instructional strat- 
egy of such a system therefore cannot be 
seen in the same terms as that of a linear or 
branching or iterative drill. Its curriculum 
is tne construction of knowledge itself. 

Conclusion 

In summary, the powerful ideas of concep- 
tual modelling have to do with practical 
epistemology. Building a knowledge base 
does in practice instruct the student in 
more than the domain-spednc knowledge 
which may form its contents. Conceptual 
modelling is instructional^ active in the 
culturally significant area of the construc- 
tion of knowledge, at a level at once distinct 
from and inclusive of the transmission of 
contained knowledge. 

I have argued that, within the knowledge- 
engineering approach, a putative gap be- 
tween a student's mental model and the 
model of knowledge internal to an ITS can 
be exploited as a dynamic of human learn- 
ing, rather than seen as a problem for the 
machine to solve. Instead of bringing the 
student's knowledge into a correspon- 
dence with system knowledge, and testing 
for that direction of correspondence, the 
reverse becomes true. Both the machine- 
based and the personal models will un- 
dergo dynamic alteration as the one, and by 
implication the other, is brought to a new 
designated and testable standard of knowl- 
edge. 
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The role of a (human) teacher, and the 
responsibilities to guide and instruct are 
clearly not undervalued or affected by the 
alternative knowledge-engineering ap- 
proach. The communication of an existing 
and contained body of knowledge, with 
which the student is to work and be 
equipped, is not necessarily impeded by 
doing this. It is not impossible that stu- 
dents' knowledge will remain unmodified 
by this process of exploration, construction 
and instruction of the ITS. Normal evalu- 
ation and assessment procedures in a terti- 
ary level institution are not disregarded. A 
constructive form of independent learning 
becomes possible, and particularly valu- 
able in periods of financial constraint. 
Support for the student's activity can be 
provided in a variety of forms: available 
knowledge-based materials, such as lec- 
tures, tutorials and textbooks; and content, 
procedural and process advice om hu- 
man teachers. It can then be argued that a 
student is in a better position to develop a 
deeper understanding of knowledge that 
may otherwise have been rote-learnt. 

The approach leads me to reverse an earlier 
quotation from Yazdani and Lawler (1986): 

(ITS) user-oriented intelligence is con- 
trolled by students' instructional 
strategies which present the tutor with 
(domair .-specific) problems and then 
test for understanding of the knowl- 
edge, generally conceived of as a col- 
lection of methods for problem solv- 
ing, as well as domain-specific 
knowledge.fmy emphasis and altera- 
tion] 

The "considerable strengths'' of ITS as 
described by Yazdani and Lawler also 
stand up well to this re-viewing and re- 
phrasing. Once a student has finished 
building a particular system that passes all 
the tests an assessor can devise, it then "will 
have a well articulated curriculum embod- 
ied in its domain expertise". It will also 



have an "explicit theory of instruction rep- 
resented by its tutoring strategies", except 
that here the tutoring strategies are those of 
construction, and the explicit theory of 
instruction is based on its connection with 
construction. And finally, as expected of an 
ITS, the "achievement of its goal, in prin- 
ciple, can be unambiguously evaluated". 

There is an entertaining sense, in the fore- 
going, of doing things to tutoring systems 
that they were supposed to do to you. More 
seriously, though, connections are possible 
between the knowledge-engineering ap- 
proach and the use of general computa- 
tional environments which also span the 
four standard models of computer usage in 
education. Their major characteristics can 
be described as: an openn ess to user access, 
and a continuity between what the user 
does with them and the means of their own 
construction. An important example is af- 
forded by Boxet (di Sessa, 1982). 
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The useful fate of Prolog In education is to open 
and join the way to educational knowledge- 
engineering, within a general framework of 
conceptual modelling. Together with work in 
wide and sometimes apparently disconnected 
areas, it contributes to the possibility of a new 
approach to teaching and learning mat incorpo- 
rates many of the strengths and ameliorates 
some of the weaknesses of its precursors. 

The confluence of a number of strands 

Building knowledge bases for educational 
purposes is a useful approach to teaching 
and learning with the technology of Artifi- 
cial Intelligence. This paper briefly reviews 
a number of educational and knowledge- 
representation research projects which 
have contributed to, or can now be linked 
under the heading of, educational knowl- 
edge-engineering. 

Work with Logo in the development of 
computer-based modelling environments, 
and with Prolog in a movement towards 
the educational construction of knowl- 
edge-based systems, are two important 
contributory strands. Concept mapping 
and conceptual graphs are examples of 
two distinct activities, the one educational 
and the other technical and theoretical, 
which can also be connected in this way. 

Prolog and the idea of educational 
knowledge-engineering 

Asoneof theimportant strands converging 
on the idea of educational knowledge- 
engineering Prolog (Programming in 



Logic) has induced a shift of interest in this 
direction by both its strengths and its weak- 
nesses. 

Amongst its strengths in principle: 

• it is an easily available knowledge-rep- 
resentation and knowledge-base build- 
ing tool, with elementary logic as a dis- 
cipline of construction within a broader 
rule-based methodology; 

• it has encouraged the sense of an 'or- 
ganisation to knowledge' which chil- 
dren can easily appropriate and master; 

• it has also facilitated, to some extent, the 
placing of novice students in the 

• role of builder of the expert system; 

• its major strength is its support in prin- 
ciple for the representation of concepts 
and a consequent conceptual modelling 
activity. 

Amongst its weaknesses in practice: 

• an otherwise appropriate view of logic 
as a discipline ''in its own right fading 
to the promotion of logic as a single 
important "backbone" (Ennals, 1984) to 
more general areas of knowledge; 

• hence, conflict with the ways in which 
people actually / know / , and other more 
flexible means of knowledge represen- 
tation; 

• an overemphasis of the value of declara- 
tive as opposed to procedural knowl- 
edge, which implies a static or finished 
state to knowledge; 
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• a consequent assumption that, given a 
complete specification of a problem, 
problem-solving is to be carried out by 
the machine/ overlooking whence the 
specification is to come; 

• inherent difficulties in declarative logic 
of dealing with change of state and 
dynamic alteration of the knowledge- 
base; 

• in the controversy over procedural and 
declarative interpretations of a logic 
program, a confusion of the procedural 
interpretation with process issues to do 
with actually developing a program in 
logic; 

• hence an under-valuing of the dynamic, 
modelling and prototypingprocessesof 
developing a knowledge-base in de- 
clarative logic; 

• limitations and complexities in inter- 
face, syntax and environment militating 
against the construction by novices of 
substantial and non-trivial knowledge- 
bases; 

• and, as a database and query language, 
it has tended to sidetrack researchers 
into using it as an unecessary substitute 
for other more general and perhaps 
more easily used database and query 
languages. 

Detail of the arguments for these assertions 
can be found in Stem, 1986a, 1986b. 

Its strengths and weaknesses may be sum- 
marised as: support for knowledge-base 
modelling, and the limitations of a purely 
logic-programming point of view. Both 
have contributed to a broadening move- 
ment beyond Prolog itself. 

Indicators of transition 

The Prolog education movement is in rapid 
transition. It could be said that it gained 
some impetus as a bandwagon from the 
faltering, in France in 1982, of Logo as an 
educational vehicle. Subsequent experi- 
ence following promotion of Prolog and of 
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logic programming as a language for 
children's learning has led to a revision of 
its role amongst a broad and richly varied 
set of educational vehicles to avoid a simi- 
lar herxse-like effect. 

As a sample of aspects of the change, it is 
instructive to review Ennals (1985) com- 
ments on a report evaluating the the Logo 
experiment at the Centre Mondial de Pr v - 
gramma tion. Ennals translates part of the 
report as follows: 

...if one looks at the computer prod- 
ucts of the pupils. . .one is struck by the 
uniformity of the results and by the 
wretchedness of the programs... ,(An) 
hypothesis would be that the com- 
puter facilities... are too limited and 
impose too much computer thinking (as 
opposed to simply thinking) on the 
programmers, and that the uniformity 
of the results (in Logo it is rare to see 
programs which escape from the 
square and the house) is only a direct 
reflection of the weakness of the means 
at their disposal and the inadequacy of 
such computational constructs (and 
these languages) for expressing the 
mechanisms of problem solving, (p. 
59) 

and goes on to comment: 

There had been a tragic mismatch 
between potential and expectation. In 
many cases... the specification docu- 
ments describing the problems to be 
dealt with were clear and explicit 
(much of the text could be run directly 
as Prolog databases!) but the Logo 
Turtle was hideously inadequate to 
deal with the diversity of problems/ 
particularly in the hands of unpre- 
pared researchers. 

I have argr xi elsewhere the inadequacy of 
argument .orPrologasanexpressionofthe 
"mechanisms of problem solving". There 
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has been, if not a tragic mismatch of poten- 
tial and expectation, a tension between 
what was and could be done with the lan- 
guage, and what was said about it For 
example many promotes of problem-solv- 
ing with Prolog (such as Conlon, 1985; 
£101315,1984, 1985) were, in the midst of 
their assertions of the advantages of de- 
clarative interpretations of programs, as 
was said of Milton, of the Devil's party 
without knowing it 

Other researchers, such as Cumming 
( 1986) have cautiously begun to raise issues 
of limitations, beyond those of syntax or 
interface, to Prolog as a general educational 
medium. At the same time seme inherent 
strengths to the educational use of the lan- 
guage are acknowledged: 

The restrictiveness of Prolog's struc- 
tures for knowledge representation 
limits its educational applications, but 
still allows a usefully wide range for 
exploration. The severity and precise 
nature of the limitation has yet to be 
determined. Most importantly, 
Prolog and EMITSI provide an envi- 
ronment that is very friendly for learn- 
ers and can support a wide variety of 
activities, including using, modifying 
and building small expert systems, (p. 
60) 

Indicators of this transition towards a more 
general authoring and knowledge-base 
construction approach can most clearly be 
seen, for example, in the work and publica- 
tions of PEG (the Prolog Education Group 
at Exeter). Workers in the group produced 
a number of authoring programs written in 
Prolog fo* use at first in the teaching of 
history through modelling and simulation. 
The software included simple decision-tree 
modelling of historical choice and action, 
an adventure-game building system, and 
database construction and query systems 
(Briggs, Dean & Nichol, 1985) A major 
weakness in this work, as far as the promo- 
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tion of Prolog was concerned, has been the 
extent to which other software, such as 
simple database and query languages, 
could have done what their Prolog-based 
software did (Stem, 1986a). 

A recent PEGBOARD editorial (Autumn 
1986) began by asking the question: 

When does a bandwagon become a 
hearse?... There is a danger of over 
enthusiasm, and making claims 
which cannot be substantiated, or 
which other factors can explain. 

and concluded with: 

The key concept is that of learning with 
computers, where the computer is seen 
as a powerful tool for learning. Proicg 
has a triple part to play here; the teach- 
ing of logic programming in order to 
develop logicM thinking, the writing of 
logic ...programs to develop under- 
standing of a problem or a topic, and 
the use of authoring prograinsor shells 
to achieve the same goal. The writing of 
Prolog programs and Prolog shells are 
based upon analysis of the logical 
struc hires of knowledge within subject 
domains. They force the writer of a 
program, be it a simulation, adventure 
game or database to structure the 
knowledge which the program repre- 
sents. Prolog can have universal appli- 
cability in the development of logically 
based thinking within the triangular 
structure of subject knowledge do- 
mains' conceptual, procedural and 
prepositional knowledge. (Nichol, 
1986, p.5) 

The concluding sentence indicates a recu- 
peration not only of Prolog's original edu- 
cational aims (the "teaching of logical 
thinking") but of more general educational 
Jjrtowledge-engineering and knowledge 
representation issues (the disciplining of 
the "writer of a program. . .to structure the 
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knowledge which the program repre- 
sents'')/ in a context in which "preposi- 
tional knowledge" is only one component. 

In effect, it is no longer Prolog that has 
"universal applicability 7 ', despite Nichol's 
re-assertion in the context of the "develop- 
ment of logical thinking" above, but a more 
general educational approach using 
broader knowledge-representation and 
knowledge-base building tools. That con- 
struction environment, which of course 
must include a rule-based and declarative 
logic methodology, need not be restricted 
to it, as a review of commercial knowledge- 
engineering systems and architectures will 
confirm (for example: Friedland, 1985; 
Fikes & Kehler, 1985; Hayes-Roth, 1985; 
Genesereth & Ginsberg, 1985). 

Examples of this kind of integrated and 
tool-kit providing environment abound in 
industry, and to certain extent in education 
for limited purposes such as the study of 
artificial intelligence or cognitive mecha- 
nisms (for example POPLOG: Sloman etal., 
1983; Gray, 1984). Most examples do not 
focus on the educational effect of building 
knowledge bases themselves. Boxer (di 
Sessa, 1982) is worthy of mention in this 
context, because as Nichol reports (1986) it 
is beginning to attract some interest in 
Europe as an environment for learning. As 
an "authoring environment" it is described 
by PEG workers as a kind of next step, 
something which "combines the learning 
features of Logo, Prolog, LISP and Small- 
Talk in one environment" (Nichol, 1985, 
p.6). 

Logo Modelling and Concept 
Modelling 

Logo har done more than provide a spring- 
board for Prolog. There is an important 
connection between modelling a set of 
concepts in a language like Prolog, and the 
body of modelling theory that has grown 
up around Logo. 



While modelling in Logo tends to be asso- 
ciated with the graphic presentation of 
turtle-behaviour, there is a more general 
point. The behaviour of such models is 
controlled at the level of program state- 
ment, a textual and linguistic level that 
opens up more general possibilities of us- 
ing a list-structured language for symbolic 
representation. It is at this level, that the 
most important link with Prolog exists, 
since developing a knowledge-base model 
in Prolog is essentially a process of testing 
and extending the meaning of statements 
in a concept-description language. 

The assertions that a Prolog sxpert-system 
is a learning microworld and an object-to- 
think-with, and that Prolog is a computer- 
based learning environment for creating 
such microworlds, can be confirmed by 
reference to current work in microworld 
theory (Adams, 1986) and by a reading of 
Paperf s Mindstorms (1980) from the par- 
ticular point of view of modelling with 
concepts. 

A learning microworld (Adams, 1986) is 
both an environment for the construction 
of models, and a working model itself - a 
recursive, hierarchical composition. Every 
constructed model possible within a given 
environment is defined by the (essentially 
linguistic) set of instructions which consti- 
tute its program. Expert-systems no matter 
how small or prototypical can be viewed as 
microworlds-as-models, with defined behav- 
iour and scope of activity, created within an 
microworld-as-environment. 

Concept models in Prolog display key fea- 
tures of the modelling process. One is able 
to examine the model's behaviour, circum- 
scribed by the program thai defines it, and 
to change the scope of its possibilities of 
behaviour by concrete means - that is, 
simply editing the program and re-running 
it. The 'closed world' of any Prolog pro- 
gram, within an environment that allows 
this world to be changed, matches the con- 
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cept of a learning micro world very closely. 
The important point is that one can always 
edit that closed world within the environ- 
ment supplied by the Prolog progrananing 
system. 

An insistence on a declarative world in 
which nothing ever // happens // makes a 
problem out of this creative editing pi ocess 
where none really exists. Furthermore, 
simply adding procedural capabilities to 
Prolog as a programming language, or 
turning to procedural interpretations of a 
logic program, does not represent a full 
response to the issue of building concep- 
tual models in and through time. For ex- 
ample, extending Prolog to include Turtle 
Graphics (Kowalski, 1984) does not extend 
the notion of a learning microworld in 
terms of the significance of the editing and 
modelling process. 

The body of microworld theory that has 
grown up around Logo expresses the idea 
of the computer as ultimately a tool for 
thinking about thinking - an extension of 
the more particular instances of the com- 
puter as means of thinking about some- 
thing. Building knowledge-bases ex- 
presses this idea perhaps even more neatly 
than building abstract mathematical struc- 
tures in turtle geometry. A small Prolog 
prototype expert-system is explicitly a 
microworld for thinking about thinking. 

Concept Mapping and Conceptual 
Graphs 

The confluence of the tributary strands 
discussed above, with the experience in 
industry of the human-learning effect of 
engineering a knowledge-based product, 
can form the basis f™ a generalised and 
inclusive notion of conceptual modelling 
as both a learning activity, and a knowl- 
edge-base construction activity. There are 
paths to this idea, from two distinct and 
yet-to-be connected areas of research in 
knowledge-representation. 



The first, concept mapping (Novak & 
Gowin, 1984) is an educational technique 
which has so far been done without com- 
puters. It derives from studies in cognition 
(Ausubel, Novak & Hanesian, 1980), and 
connects with knowledge representation 
techniques for computers, in particular 
semantic networks and more generally a 
formulation of concepts and their linkages 
in terms of connected graphs. Kay (1986) 
has described the use of computer-based 
concept mapping in an educational con- 
text, but restricted her interests to a means 
of representing knowledge in a form by 
which an intelligent tutor system could 
confirm that a certain body of knowledge 
had been successfully communicated to a 
student. 

The second is in fact a significant generali- 
sation of the first, but one in ^vhich all 
educational implications have so far been 
ignored. Computable conceptual graphs, 
and hence the idea of a conceptual graph 
processor which could include all the fea- 
tures of logic programming, are the work 
initially of Sowa (1984). This work is almost 
exactly contemporary with thr f of Novak 
and other researchers in educate nal con- 
cept mapping. Neither Sowa l or Novak 
acknowledge the existence of each other in 
their work, nor so far have th/ '-olio /ers. 

There is an obvious and missing connec- 
tion to be made. The link is of course che 
educational knowledge-engineering ap- 
proache, provisioned with an easy-to-use 
and yet universal means of knowledge 
representation -a conceptual p aphproces- 
sor with the technology and the interface 
that would make it usable by novice stu- 
dents. At present theoe provisions by the 
technology are purely speculative. 

Conceptual modelling as practical 
epistemology 

The confluence of the four strp *s above 
with the educational effects ena -ed in 
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commercial knowledge-engineering leads 
to a more general notion of conceptual 
modelling to describe the process. 

Central to this idea is a view of the learner 
as a constructor of his/her own knowl- 
edge, as proposed by Papert (1980). It can 
be summci up in the proposition of learner 
as epistemokgist It captures an important 
abstraction from learning, which broadens 
and distinguishes it from a matter of com- 
munication and of memorization. Concep- 
tual modelling in an interactive and recon- 
structable medium is a concrete expression 
of the proposition. That is to say, concep- 
tual modelling directed by the learner is 
practical epistemobgy. 

This view helps to meet an objection, put 
forward by i azdani and Lawler (1986) that 
a "model-based epistemology of instruc- 
tion does not exist". Concept model-based 
systems teach very concrete and specific 
things about knowledge. Its real "instruc- 
tional strategy" is to demonstrate, through 
a studenf s modelling activity, a number of 
personally and socially significant episte- 
mological statements. The ability to run a 
concept model is an instructive and live 
demonstration of the answer to the ques- 
tion one frequently ask f othe/ people: 
how come they can think r say) that? This 
is practical epktemology. 

Conclusion 

The useful fate of Prolog in education is to 
open and join the way to educational 
knowledge-engineering, within a general 
framework of conceptual modelling. To- 
gether with work in wide and sometimes 
apparently disconnected areas, it contrib- 
utes to the possibility of a new approach to 
teaching and learning that incorporates 
many of tht strengths and ameliorates 
some of the weaknesses of its precursors. 
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Increasing active learning in a CAL 
environment 



Willianr A, Stewart and Jack Flanagan, 
Nepean College of Advanced Education, 



Computer are claimed to have a powerful role to 
play in tertiary education, yet most programs 
available in the business education field have 
not displayed a quality which makes the claims 
for computers convincing. Beyond specific-pur- 
pose computational aids, progress has been 
slow. At the heart of this slow progress is the 
demand on the computer- learning innovator to 
cover three disparate fields; the academic skills 
for her/his discipline, the educational skills for 
effective communication, and the systems and 
programming skills to achieve an understand- 
ing of possibilities for CAL. 

This paper uses one element of a managerial 
finance course to explore these issues as they 
were experienced by the presenter and his co- 
author. By demonstration the paper traces the 
origin of a program, its development in early 
use, and program modifications as the experi- 
ence of four semesters' use demonstrated that 
learning experiences fell short of the authors' 
goals. Modifications were continually at- 
tempted to improve the active learning aspect. 
The paper presents a preliminai y evaluation of 
the learning outcomes and generalises these to, 
similar tasks in the business education environ- 
ment. 

A feature of accounting and financial soft- 
ware is that the system controls of account- 
ing programs are often a direct hindrance 
to the new user. The penalties for wrong 
entries are usually re- entry of data in sepa- 
rate runs, enshrining all mistakes as a per- 
manent reminder of misdemeanour. A 
potential benefit of computer learning has 
always been the non-threatening nature of 
mistake correction. Mistakes are electroni- 
cally erased, and only finished successes 
show: the accounting security and audit 
trails are thus in direct conflict with educa- 
tional goals. 

O 
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Problems for business education 
software 

There are substantial differences between 
business software and educational soft- 
ware on business topics. The focus for 
business software is on input-output rela- 
tionships where the outputs from the sys- 
tem are the major benefit. Most business 
software on any specific topic will use a 
"black box" approach, hiding the process- 
ing aspects from the user. 

Educational software on business topics 
has a different set of needs. While the out- 
puts, the results of data manipulation or 
computation, are useful, the educational 
aspects of most interest are usually the 
relationships, and the processes them- 
selves. The assumptions that have been 
made about the environment are also of 
importance. All of these aspects the com- 
puter must make available to the student. 
For such reasons many business educa- 
tional institutions have taken up the 
spreadsheet as a contribution to business 
education. 

Of course the spreadsheet is also a widely 
used tool in business, and knowledge of 
such a tool must enhance employability, 
but the educational aspect is thai the stu- 
dent must develop the model her or him- 
self, and thus focus on the process, not 
solely the outputs. 

For the one-page process such as a budget 
or cost analysis the learning time for the 
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spreadsheet is reasonable and the ability to 
manipulate data on a "what-if ' basis can 
provide powerful insights. Our purpose in 
this project, one in a series of attempts to 
use the computer in business education, 
was to provide some of theseaspects, but as 
well to develop something more elaborate 
as a teaching tool. 

Problems from developing your own 
software 

As a general comment, much of 'he soft- 
ware received in business education to date 
is poor, particularly by the standards of 
commercial products. An exception to that 
assertion is the range of accounting sys- 
tems, where the available products in both 
business and education vie with one an- 
other in inscrutability, unfriendliness and 
just plain "orneriness". 

There are reasons why good education 
software for business courses is slow to 
arrive, for three skills, not the usual two 
(knowledge of problem/knowledge about 
systems-programming), are demanded. 
The software developer must have a good 
technical understanding of the area, must 
have strong educational motivations, goal s 
and insights, and lastly must acquire some 
system and programming skills to execute 
the technical and educational tasks to meet 
the objectives of the system. We might add 
also that there are few if any financial re- 
wards for such developments. 

Beyond that, the prescriptions for develop- 
ing appropriate software at the tertiary 
level are difficult to find. 

In a previous working paper (Flanagan/ 
Stewart 1985) we explored ideas from the 
education area which might guide the 
preparation of business education soft- 
ware. Of particular interest were the works 
of Gagne(1965) and Ausubel(1968) on the 
cognitive processes of education. In addi- 
tion, Rushby(1975) had written on the 



computer-specific applications of educa- 
tional ideas. (For brevity of this paper, we 
have chosen to provide discusion on these 
points by way of a handout to workshop 
participants.) 

What emerged from this study was a set of 
general guidelines. We did not have a 
position on whther our students were ho- 
listic or serialistic learners. It was in keep- 
ing with the method of teaching that the 
process of the progrma followed a serialis- 
tic pattern, bue important that the student 
should have the widest possible control 
over the sequencing of access to aspects of 
the program. 

User-friendliness was a vogue term not 
given much "operability" in the literature 
we read, but in our efforts was to be repre- 
sented by careful control of inputs to avoid 
program crashes, context-sensitive help, 
and simple recovery processes from errors. 
The s°tting in which the user operated was 
the crowded typical college/university 
computer room, and use of bel! or beep, a 
humiliating announcement to the room 
that the user had "goofed" again, was to be 
avoided. 

Where possible, we would try to have 
educational software mimic the better ef- 
forts of commercial software to provide a 
familiar interface, and one that operated 
bethr than the restrictive and censorious 
software we were currently using. 

As proceeding in such poorly charted terri- 
tory represented such a threat, it seemed 
appropriate to tackle small tasks with ap- 
parently simple requirements. Specific 
feedback on success or failure could be 
ascertained more readily if the task were 
small and specific. 

Our purpose in this workshop is therefore 
to explore our experiences so far, and by 
such exposure help others attempting to 
cover the same territory. We hope to have 
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commentary giving other explanations as 
to why/ where we went wrong, or where 
we should have gone instead. 

This particular task 

The subject chosen for exploration was the 
financial evaluation for the comparison of 
leasing with other financing options, some- 
times shortened to 'lease versus borrow- 
and-buy". As an educational task it in- 
volves a series of computations, present 
value analysis, and the understanding of a 
set of environmental relationships which 
affect the financial outcome. A simple 5- 
year example involves about 70 sequential 
computations. 

Because of the computation volume, stu- 
dents, in our teaching experience, are loath 
to do much exploring of possible combina- 
tions, and gain insights to the interactions 
and influences which determine the deci- 
sion outcome. Lecturers are none too keen 
either to create and mark examples, and the 
texts can usually afford one simple-to- 
niediumcomplexityillustration. Rarely are 
there enough illustrations for practice, nor 
sensithity-tested parallel examples. Illus- 
trations in class are excessively time- con- 
suming unless trivial examples are chosen 
and demonstrated at speed. 

The program goals 

The program goals were to :- 

• make available a demo?iStration pro- 
gram which solved the lease versus 
borrow-and-buy analysis 

• permit the student to generate prob- 
lems for self study with answers io 
permit self-assessment 

• tutor and explain the problem and proc 
ess sufficiently to permit students to 
have their questions answered without 
lecturer assistance 

• provide references for further reading 

• provide a browsing facility to stimulate 
curiousity. 



Operationally, the program would require: 

• no instruction beyond disk loading and 
program name 

• crash-proof data entry 

• non-threatening error cqrrection 

• no consumables beyond hard copy 

• minimized likelihood of assistance re- 
quests from data processing personnel 

• outputs in a familiar or expected format. 

Program failure and the first revision 

The first implementation of the program 
ran in compiled Microsoft Basic on DEC 
Rainbows. It had been tested on a student 
who had an unreasoning fear of anything 
involving mathematics. As an assignment, 
she was asked to use the program to hr'p 
her with the task, report on difficulties or 
weaknesses, and suggest improvements. 
She was tested for competence at the con- 
clusion of her assignment. 

As a result of her suggestions, before some 
processes could be accessed, a multiple- 
choice question which addressed the major 
purpose of the process was installed to act 
as a "sentry" to each process. Before a proc- 
ess could be used, the question had to be 
answered correctly. A short tutorial on 
what was wrong with an answer followed 
: n incorrect response. 

Confident in the usefulness of the en- 
hanced program, the program was used for 
several classes the following semester. 
Apart from some minor problems with 
data en try, stx lents succeeded in using the 
program for a conventional assignment. 
Subsequent testingof their ability to do the 
same type of problem manuallv showed no 
sign that the program had asbioted them to 
gain the intended skills or insights. Post- 
mortem discussions with students showed 
that few had been curious enough to use 
the help screens or the tutorial, and had also 
failed to absorb the understanding of the 
broad processes guarded by the multiple 
choice questions. 
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The second revision 

For the following semester, a more lengthy 
assignment required the students to do a 
variety of problems using the program; a 
series calculating tasks which would have 
been too onerous manually. It was thought 
that more continuous exposure to the pro- 
gram might have stimulated experimenta- 
tion and enquiry with the use of the tutorial 
and help screens. 

Tutorial discussions, class testing and oral 
quizzes revealed that more use had been 
made of the program features, but that too 
large a proportion had asked other stu- 
dents for the answers or rote- learned the 
required responses and processed the in- 
formation mechanically without learning 
taking place. 

It is reasonable at this point to divert to 
question whether we had arrived at any 
more than a reminder of the adage : "you 
can lead a horse to water but you can't 
make it drink" and therefore that you can- 
not force learning to take place. There is 
truth in that, but it must be understood also 
that the student is under competing pres- 
sures to acquire all sorts of skills and 
knowledge. Knowing when one has the 
required knowledge and skills so that it is 
safe to switch priorities, is one of the diffi- 
culties of a content-overladen curriculum. 

We decided therefore that the signals on 
when it was safe to stop needed to be 
clearer to the student. The structured set of 
problems was extended in the following 
semester. These required resetting of the 
problems, particularly the environmental 
features, and needed closer study of the 
computations if the questions were to 
be answered. 

The results of this stage showed that stu- 
dents had made more use of the help facili- 
ties and had used the options in the pro- 
gram more than previously. Some students 



suggested further computations and pres- 
entations which would have made data 
available in forms that matched their way 
of thinking about the problems. While this 
represented progress of the sort we had 
hoped for, there was still a disappointing 
lack of competence in performing the ac- 
tual task of an analysis under exam condi- 
tions. As a generalisation, it could be said 
that their interest and understanding had 
been increased, but that the performance of 
particular skills had not improved to the 
degree hoped for. A series of intensive 
workshops would, on past experience, 
have brought the students to a higher skill 
level. 

The present program 

As the inability to display the technical 
skills of the analysis seemed the problem, 
the present revision requires the student to 
complete one iteration of each of the key 
analyses. The program makes the remain- 
der of the analysis available after an at- 
tempt. Wrong answers are flagged, but the 
analysis is always provided. 

After two successful attempts at each of the 
tasks, the student is freed from further 
demands by the program, and may make 
any number of further changes to inputs 
without entering one line of the iteration. 

Class testing indi:ates that this procedure 
has had some success in improving this 
level of skills, though at the time of writing 
(July 1987) there has not been a testing 
under final examination conditions. 

Summary 

Our purpose in this workshop has been to 
discuss the progress of an attempt at the 
development of a computer-assisted learn- 
ing process. The goals of this process can be 
seen in hindsight as naive in that the pro- 
gram provided an opportunity for experi- 
mentation and serendipitous discovery. Li 

SO 



* u Using Computers Intelligently 

the task- intensive environment of a busi- 
ness school the stresses on the student do 
not provide ihe atmosphere for such a 
learning process for most students. 

Some level of success has been reached by 
a more exacting setting of the problems 
which the student has been required to 
explore or solve. However, the program 
becameagainatooltoassistlea ningrather 
than a self-contained environment of learn- 
ing, which had been the unrealistic goal. 

Because many business problems require 
both an understanding of the setting and 
the problems within that setting, with also 
a set of exacting technical skills for prob- 
lem solving, others may be forced to the 
stratagems we haveemployed. The power- 
ful computational processes which the 
computer can cany out and display may 
pass before the eyes of the passive student 
without any jpsponse. Forcing the student 
to participate in aniterationof the solution, 
as well as problem solving for answers on 
the influence of environmental factors, 
seem io have been responsible tor the 
improvements we have noted. 
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A multi-level dynamic Help subsystem for in- 
teractive software is described. By combining 
information about the user's history and pres- 
ent situation a system can offer help that is 
directly related to a user's needs. A number of 
help techniques are discussed including dy- 
namic example generation. 

There are many similarities between offer- 
ing intelligent help to a user of an interac- 
tive software package and intelligent tutor- 
ing in computer assisted learning (CAL) 
systems. In both environments, an accurate 
model of the student, or user, must be 
maintained if appropriate assistance is to 
be offered. A help system, however, is not 
concerned with teaching concepts in- 
volved with learning how to solve prob- 
lems with a computer, or presenting les- 
sons to the user to be answered and evalu- 
ated. Intelligent help system** need to offer 
more than static script based assistance 
driven by some form of lookup mecha- 
nism. To be truly useful, help must be per- 
sonalized. Personalized advice implies 
keeping a model of the user and analyzing 
this model to determine the appropriate 
form of coaching to provide. In this paper, 
we investigate the potential for intelligent 
help and present an implementation of a 
form of user modelling for interactive soft- 
ware with an intelligent help system. 

Discussion 

There are three main elements to consider 
when looking at providing an intelligent 
dynamic help subsystem. These are: 



1. Hierarchical Help Systems 

2. Computer Coaching 

3. User Modelling 

Hierarchical Help Systems 

Most software today comes with some 
form of hel p system. These can be on-li neor 
simply a set of manuals or some combina- 
tion of both. Of the on-line help systems 
available, there is a *vide range of assistance 
offered, from simple electronic copies of 
documentation to complete elaborate tuto- 
rial systems (Houghton, 1984). An example 
of the elaborate form of help is the Do What 
I Mean (DWIM) facility in the Interlisp 
environment (Teitleman & Masinter, 1981 ). 
This facility will attempt to diagnose and 
correct incorrect input while leaving it up 
to the user to accept or reject the correction. 
Obvious corrections are made without 
consulting the user. Other systems like the 
SIGMA message processing system have 
on-line tutorial assis'arce with built in les- 
sons and exercises (Rothenberg, 1979). 

Another consideration for help systems is 
whether an active or passive role should be 
taken. Fischer et al (Fischer et al, 1985) 
advocate passive help in a system for the 
subset of commands a user knows a little 
about and uses occasionally and for the set 
of commands the user thinks exist in the 
system. However, active help is required to 
introduce the user to the setof conceptsand 
commands that exist in the system but the 
user has no idea about. 
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Passive help systems wait to be requested 
by the user. Typically, passive help is avail- 
able in the form of a menu driven or key- 
word system. Menu driven systems have 
the advantage over keyword systems in 
that they are hierarchical in nature and 
display a set of keywords on which help is 
available- Natural language help systems 
exist but are still not sophisticated enc;gh 
to provide adequate levels of help, primar- 
ily because of the problems inherent with a 
natural language interface. In general, 
passive help systems do not take into ac- 
count the user's present or past situation 
(Fischer etal, 1985). 

Active help systems axe characterized by 
their ability to interrupt a user to provide 
some form of advice or coaching. Interrup- 
tions are not neccessarily restricted to cor- 
recting errors made by a user, but also offer 
a more efficient method of accomplishing a 
goal than the current method being used. 
An example of this latter form is the Unix 
advisor (Kay, 1986). The important aspect 
of active help systems is that they monitor 
the user's behaviour and some attempt is 
made to reason about their goals (Fischer et 
al, 1985). One major concern with active 
help is when and where to interrupt a user. 
A help system that continually interferes 
becomes a nuisance whereas an active help 
system that never offers help is simply a 
passive help system. Some form of judge- 
ment needs to be used to adequately serv- 
ice the user's needs. Support should stop 
when a command has been successfully 
mastered by the user. One method is to give 
the user control over the level of help inter- 
face they are using. 

Computer Coaching 

Personal tutoring is a very effective method 
of teaching, especially when coupled with 
additional formal instruction either indi- 
vidually or in a group. It is important that a 
tutor does not interrupt too frequently as 
this can lead students not to discover from 
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analyzing and attempting to correct their 
own errors. A tutor must know when to 
interrupt a student and what to say when 
this interruption occurs (Burton & Brown, 
1982). These principles apply to designing 
an effective help system. In a help system 
the advice giving element is basically a 
computer coach. To offer the most effective 
advice, a tutor must know somethingabout 
how students learn and when they are the 
most receptive to such advice. The same 
applies to help systems, except that a user 
often initiates the interaction. With a dy- 
namic help system the 'coach' takes on the 
role of tutor by not waiting for the user to 
ask for help. But, the scope of assistance 
that a help system provides is limited to the 
concepts and commands of the interactive 
software that is being used. A tutor, on the 
other hand, offers advice on all aspects of 
the problem at hand, not just the tool cur- 
rently being used. This last point means 
that an intelligent dynamic help system 
needs to embody much less information in 
its knowledge base. This also implies that 
less knowledge needs to be stored when 
compiling a user model. 

User Modelling 

A student model has been defined by 
Clancey, (Qancey, 1986), as a set of records 
that describe a student's knowledge about 
what is being taught so that the program, 
with the interaction of the teacher, if neces- 
sary, can adapt its presentations to the 
student's needs. The classification of stu- 
dent or user models can be achieved using 
the following major characteristics (Rich, 
1979): 

• the model is of a canonical user or the 
models are of individual users 

• construction is explicit by the user or 
abstracted by the system from observ- 
ing users' behaviour 

• the model embodies short-term 
specific information or long-term 
general information. 
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For a user model to be useful it must con- 
tinually evolve to accurately reflect the 
change in a user's knowledge. This can be 
achieved by maintaining a record of a 
user's correct and incorrect usage of a sys- 
tem. According to the classification above, 
the model described in this paper acquires 
its knowledge implicitly to create an indi- 
vidual model of a user. The kind of knc 
edge that is embodied is primarily short- 
term knowledge about specific constructs 
and concepts. However, as a user builds 
knowledge over time, a long-term model is 
available by continuous analysis of the 
acquired data. At some point, a user could 
be determined to have mastered a system 
and the form of advice offered would auto- 
matically change to a passive role. 

There are various methods of implement- 
inga model. Some of these include overlays 
using genetic graphs (Goldstein, 1981), 
stereotypes (Rich, 1979), scripts (Schank, 
1977), frames (Minsky, 1975), schemas 
(Bobrow and Norman, 1975) and specifi- 
cally for CAI using a procedural student 
model (Self, 1974). The model discussed in 
this paper uses a form of frame-based rep- 
resentation. 

The User Model 

The only way to build a help system that 
is not continually interrupting is to build 
and maintain a model of the current user. 
This model would represent a profile of a 
particular user's history of usage with a 
particular interactive software package. 
This model would need to embody the 
various attempts (correct and incorrect) 
made by a user when interacting with a 
system. The obtrusivenessof the help 
system can then be controlled by scan- 
ning the user's model to determine if help 
should be offered for the current situ- 
ation. 

To employ an effective user modei, we 
need to consider the following: 



• The kind of knowledge we need to 
model. 

• The method of implementing this 
model. 

• The application of this knowledge by 
the help system. 

The kind of knowledge we need to model 

The kind of knowledge we need to model 
includes the number of times a user has 
correctly and incorrectly used each of the 
commands and/or concepts available in a 
system. Incorrect usages need to be catego- 
rized in terms of the determined severity of 
the error, ranging from a typographical 
error or misspelling to a complete lack of 
knowledge of the correct form of a com- 
mand or concept. Each command may 
have a list of possible errors and the num- 
ber of occurrences of each kind can be 
compiled as in f}g 1. Also, to aid the help 
system in determining its effectiveness, for 
each command a record of the number of 
times help has been offered and what strat- 
egy was used should be kept. A later analy- 
sis may show some forms of help to be less 
effective than others for some commands/ 
concepts. A further analysis of many user 
models could indicate some common areas 
of trouble or misunderstanding. These last 
two points are very attractive to educators 
using software with such a help system 
built in. 
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The method of implementing this model 

The model is implemented in a hierarchy of 
frames. The top level frame represents the 
knowledge about all users of the system, 
(see fig. 2). It includes the number of users 
for which a model is kept, a current list of 
the ten most common errors in the system 
and one model for each individual user. 
The model for each individual user, (see fig. 
3), includes some form of user identifica- 
tion, a distinction between the number of 
spelling errors and construct errors and a 
collection of usage records for each com- 
mand/concept that user has used. This 
collection of usage records grows as the 
user attempts new commands/concepts in 
the system. The omission of a record for a 
particular construct implies the user either 
does no t know of its existence or simply has 
not had a need for its use yet. Each usage 
record,( see fig. 4), includes which con- 
struct/concept is being recorded, the 
number of correct usages, the number of 
incorrect usages, the number of times help 
has been offered, the number of times a 
user has asked for help for this construct, 
which help strategies have been used and a 
compilation of the kinds of errors encoun- 
tered as in fig. 1 , and a link to the set of static 
library examples provided for this con- 
struct by the system. 



The application of this knowledge by 
the help system 

To apply the knowledge embodied 
in the model, the help system evalu- 
ates the user model to determine 
both the appropriate level of help 
and the specific example or sugges- 
tion to provide to the user. For ex- 
ample, if the user has used a com- 
mand incorrectly the help system 
will check first to see the number of 
times a user has correctly used this 
command. If no record exists, then 
this is the initial usage by the user 
and a dynamic example could be 
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presented to the user A dynamic example 
is a powerful way of illustrating to the user 
the correct form of their specific input 
through the use of an example. If a record 
does exist, the confidence factor is calcu- 
lated. The confidence factor for a command 
or concept is the ratio of correct usages to 
incorrect usages determined for the types 
of errors a record is kept. If the confidence 
factor ishigh, say at least 3:1 and the kind of 
error is a spelling error, or minor omission, 
then the user is determined to have mas- 
tered this command and the form of help 
maybe to automaticaHy correct the errone- 
ous input while asking for the user's ap- 
proval. If the form of the error is deter- 
mined to be major, then a library example 
would probably be an appropriate form of 
help. 

One problem arises when a user is deter- 
mined to have mastered a command or 
concept and an enoneous usage occurs. If 
this error is merely a spelling error, the help 
system treats this as noise in the model. 
However, the help system has no method 
of handling the situation where a friend of 
the user for whom the model has been 
created uses the system. Suddenly, we 
have a completely different pattern of us- 
age evolving that contradicts any assump- 
tions made using the existing model. The 
only way to handle this currently is to 
strongly discourage the above practice and 
if this situation is detected by the help sys- 
tem by encountering many errors in a pre- 
viously mastered command, the system 
can ask the user if they are really who they 
should be. One possible honest cause of this 
situation would be a user who has mas- 
tered the system then not used the system 
for a prolonged period of time and re- 
turned to use it again. One could argue that 
the returning user really is not the mod- 
elled user from before. To compensate for 
this, the model could include time stamp- 
ing and erroneous usage could be checked 
against the previous date to detect any 
'stateness' about the user and this com- 
mand. 



To determine adequate levels of help and 
appropriate examples requires a substan- 
tial amount of time and effort. Thisis analo- 
gous to a tutor who must determine the 
correct form of help to provide to a student. 
No two students are the same, hence an 
effort must be made to personalize help 
and tuition. Of course, when a student 
masters a system, help becomes passive 
and inexpensive to provide. 

Domain of Application 

Novice programming environments (NPE) 
seem to fall roughly half way between a 
software engineering tool and a CAL sys- 
tem for teaching programming. Users are 
trying to develop software to solve some 
specified problem but the reason for solv- 
ing this problem using a computer and a 
programming language is to learn how to 
program in that language (in addition to 
learning other problem solving concepts). 
A useful programming environment (PE) 
must thus provide the user with some tools 
to enhance the efficiency of the program- 
ming task. To deal effectively with novice 
users, some consideration musi be given to 
accommodate the fact that the user is learn- 
ing by doing rather than an expert purely 
trying to write a program. This considera- 
tion can be in the form of a useful help 
system that changes dynamically with the 
user's anticipated needs. One method of 
accomplishing this is to model the user's 
history of the various language constructs 
and concepts to use as a reference when 
offering help. 

A NPE for Pascal programmers using 
Macintosh computers is currently under 
development at James Cook Ui y, 
(see Waugh, 1987). The current version of 
the system uses a static help system that is 
obtrusive and predictable. A user builds a 
Pascal program statement by statement. 
When an error is encountered by the sys- 
tem, an attempt is made to generate a sug- 
gestion which is then offered to the user to 
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accept or reject. If a suggestion cannot be 
generated, the user is told the current state- 
ment is unrecognized by the system. An 
indication as to where the error occurred 
together with an explanation of the type of 
error is provided (as per typical compiler 
output). A static help system is always 
available in the form of a menu-driven 
keyword based system. At any time a user 
may browse the help system for an expla- 
nation and/or example of any concept or 
construct for which help is available. 

This form of help can be improved by pro- 
viding a multi-level dynamic help subsys- 
tem as described in this paper. The full 
potential of these ideas is realized by giving 
the user some control over the level of 
interface they are inte\ acting with. Thehelp 
system is organized into two levels (see fig. 
5), the first being for experienced users 
while th2 second is for novice and inexpe- 
rienced users. The first level provides a 
script based system coupled with the abil- 
ity to generate a dynamic example using 
the user's erroneous input should the user 
reruest it. The second level provides the 
same functionality as the first only the user 
model is consulted on every erroneous 
input to determine if advice should be 
given. All usershave the option of choosing 



which level of help they would like, but 
many novice users would usually choose 
the interface that would be most beneficial 
to them. This allows an experienced user to 
avoid the overhead in (he system of build- 
ing and maintaining the user model as well 
as avoiding the dialogue and interruptions 
inherent in the intelligent help level. The 
first level interface maintains information 
about the user by modifying the particular 
user model (hence the one way connection 
in fig. 5) in case the user reverts to the 
second level interface during a later ses- 
sion. 

The overall implementation of such a help 
system incorporates the lecturer, tutors 
and students for a particular course and the 
help subsystem fo f a particular package, 
introductory Pascal programming and a 
Pascal PE in this case. The interrelation- 
ships of these various elements are indi- 
cated in figure 6. Thus if a particular stu- 
dent continues to make a particular error, 
the level of HELP provided is increased 
and if a class of students persistently make 
the same error, the HELP facility detects a 
teaching problem and advises the LEC- 
TURER to check and modify, if appropri- 
ate, the tutoring approach for that class, 
both human and HELP, as indicated by the 
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connection from HELP to LECTURER la- 
belled T)ata from Runs' and the corre- 
sponding links be'vveen the LECTURER 
and HELP and TUTORS. In each session, a 
student enters INPUT to the system, (pri- 
marily Pascal statements), which are incre- 
mentally compiled by the Pascal environ- 
ment. Upon detecting an error, the HELP 
system is invoked which offers advice to 
the student depending on the evaluation of 
the student model. If no error is detected, 
the student is allowed to continue uninter- 
rupted. 



The development of this student model 
therefore involves elements of artificial 
intelligence with cybernetic feedback loops 
and a heuristic learning facility combined 
with elements of database management 
with accumulated statistics for individuals 
and classes of users. After a number of uses 
of the HELP facility, assessment o( each 
student's ability in Pascal can be deter- 
mined in structural terms both semanti- 
cally and syntactically and by aggregation 
the whole class can be rated. The HELP 
system has been developed heuristically 
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with an interactive learning component - 
thus 

• the first HELP procedures are deter- 
mined using our experience as a lec- 
turer of Pascal and introductory pro- 
gramming over the past 3 years. 

• a record of the last 1 0 errors of each type 
is maintained continually for access by 
the teacher. This allows modification of 
HELP procedures, introduction of new 
prompts and the hierarchical ordering 
of the search for errors used by HELP. 

It is important to realize that the intelli- 
gence level of the student as a Pascal user 
will normally increase at a rapid rate and 
theneedfor the HELP facility should corre- 
spondingly quickly decline. The better the 
HELP system is, the lower the number of 
intrusions required by the HELP facility 
will be. 

Conclusions. 

In this paper we have shown the parallel 
between tutoring and on-line help systems 
and presented a method for tailoring the 
help to a specific user with the inclusion of 
a user model. Script based C AI models only 
capture the statistics of the number of in- 
correct matches of the user's answer 
against the set of expected answers.The 
method presented overcomes this restric- 
tion of script based CAI models by the 
inherent embodyment of the system expert 
in the help system and subsequently the 
user's model. 

It should be noted that we do not advocate 
the use of such intelligent help systems to 
replace the role of human tutors, but rather 
to enhance the environment in which stu- 
dents and tutors interact. Such a system 
would take care of many minor problems, 
leaving tutors with more time to handle the 
substantial problems like the classic 'where 
do I start? 7 situation which is only just 
O 
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beginning to be attempted to be automated 
along with other logicerrordetection prob- 
lems. A potential problem with intelligent 
help systems is where the machine incor- 
rectly perceives the user's ability forcing 
the user to do something they did not in- 
tend to do. This can be solved by giving the 
user control at all times to accept or reject 
any action taken by the system. Also, the 
help system should be as transparent as 
possible to the user so that responses are 
brief and succinct so as to minimize the 
delay and disruption in a user's thinking 
and acting cycle. 

This form of help also provides the useful 
feature of individual as well as group feed- 
back to the lecturer which promotes the 
continual growth and modification of the 
teaching style of the lecturer and tutoring 
styles of the tutors and help system. Such a 
dynamic situation can only enhance the 
efficiency and quality of the teaching proc- 
ess thereby providing room for enriched 
learning environments. 
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MacTutor: An intelligent novice 
programming environment and tutor 
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The design and implementation cf a novice 
programming environment with an intelligent 
tutor is described. The implementation pre- 
sented is for use on Macintosh microcomputers 
by first year undergraduate computer science 
students learning Pascal. .MacTutor provides 
an incremental compilation environment that 
detects syntactic and semantic errors on entry. 
A suggestion generator provides an 'intelligent' 
reconstruction of an erroneous statement and 
presents this to the user for acceptance The 
environment includes full run- time simulation 
abilities for source code debugging with fea- 
tures such as single stepping, breakpoints and 
variable traces. 

Introduction 

Programmers face the challenging task of 
producing correct, efficient and reliable 
software. This process has been simplified 
by many programmer's development aids 
such as syntax directed editors, (Donzeau- 
Gougeetal, 1984;Moms& Schwartz, 1981; 
Marlin, 1986; Moretti & Lyons, 1986; Welsh 
et al, 1986), and by self contained program- 
ming environments (PE), examples include 
INTERUSP (Teitelman & Masinter, 1981), 
the Cornell Program Synthesizer (Teitel- 
baum & Reps, 1981), and Smalltalk-80 
(Goldberg, 1983) . However, there exists a 
subclass of programmers who depend 
greatly on human assistance to complete 
their task, these being novice program- 
mers. The task of a novice programmer is 
twofold. One goal is to learn a program- 
ming language. The other is to produce 
coded solutions to various tasks set out by 
their instructor. Existing environments do 
not provide assistance in both areas. In fact, 



the assistance provided by programming 
environments to code a solution often 
imposes a significant learning overhead 
just to master the operation of the tool. This 
results in a vicious circle that often frus- 
trates novice users enough to give up. 

An ideal environment for novice users 
would provide useful feedback in terms of 
a creative suggestion as to why the error 
occurred and even perhaps a suggested 
correction. This kind of assistance can be 
developed for all of syntactic, semantic and 
run-time errors. As much effort as possible 
should be spent in reducing the overhead 
ar.d effort in learning to use both the PE 
and the programming language. Another 
possible area of assistance available to the 
novice user is a help subsystem within the 
environment. 

Such a programming environment is being 
developed and is presented here. The prin- 
ciples for this system are investigated and 
presented followed by the presentation of 
an environment for novice users learning 
the programming language Pascal on 
Macintosh computers. This environment is 
being developed for specific usage by a 
first year computer science class to solve 
programming assignments related to the 
course. 

Some of the features to be provided by the 
environment include suggested correc- 
tions, syntactic and semantic error detec- 
tion as each Pascal statement is entered, the 
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ability to delay subprogram definitions 
until later, the ability to test and save sub- 
programs individually and the automatic 
insertion of variables for declarations. 
Some of the run-time features available 
include single stepping through the source 
code, breakpoints, dynamic variable trac- 
ing, variable watchpoints that indicate 
each modification of a particular variable, 
plus the indication of any error that isabout 
to occur like an array index out of bounds, 
or pointer referencing to nil. Static help is 
always available to the user in addition to 
the obtrusive help ti the beginning. The 
system reduces the problem of response 
time degradation by using an incremental 
compiler. 

The major advantage of this system is a 
great reduction of time spent by a novice 
user editing, compiling, executing, re-edit- 
ing, recompiling etc. The learning over- 
head has been minimized by making full 
use of the menu and icon features available 
in the Macintosh toolbox. The appearance 
of the environment to the user was influ- 
enced in part by the environment pre- 
sented by MacPascal, (Apple, 1985). 

Discussion 

Programming Environments 

The term 'programming environment' can 
include systems that manage the complete 
software development process or an inte- 
grated tool that supports programming. In 
this paper the following definition for a 
Programming Environment given by 
Ardis et al, (Ardis et al, 1985), is adopted. 
This being: an integrated software system 
that directly supports the activity of pro- 
gramming. The systems that support the 
overall programming process are better 
labelled as software engineering environ- 
ments. 

A significant amount of work has been 
done developing environments for the 



programming language LISP. DMTERLISP, 
(Teitclman & Masinter, 1981), is perhaps 
the most well known LISP environment 
that includes such features as automatic 
error correction, an integrated structure 
based editor, sophisticated debugging, a 
compiler, and a file system. This environ- 
ment progressed from work by Teitelman, 
(Teitehnan, 1969), where early ideas on 
programming environments were formed 
from observing experimental program- 
ming using USP. Another significant con- 
tribution to the area of programming envi- 
ronments is the work done on the Cornell 
Program Synthesizer, (Teitelbaum & Reps, 
1981 ) . The Synthesizer views programs as a 
collection of computational structures and 
editing is restricted to structures defined by 
the underlying programming language 
grammar. The grammar is organized by 
templates for the i tructures and creation of 
a program is accomplished by selection 
and completion of these templates. The 
Synthesizer also provides a run-time envi- 
ronment with features such as single-step- 
ping and tracing. Another PE based on a 
structured view of a program is the MEN- 
TOR-PASCAL environment, (Donzeau- 
Gouge et al, 1984). Editing in MENTOR- 
PASCAL is restricted to using a tree ma- 
nipulation language, called MENTOL, to 
edit an abstract syntax tree. Limitations on 
the rigid nature of structure based editors 
are discussed by Welsh et al, (Welsh et al, 
1986), who advocate that editing should 
conform to the user's conceptual form of a 
program and not impose what may be an 
unnatural representation on the user. Edit- 
ing should be accomplished using what- 
ever conceptual level a user is comfortable 
with which may vary at different stages of 
the program's development. 

Incremental Compiling 

A major problem with programming envi- 
ronments is the degradation in response 
time due to repeated compilation of the 
complete program for each modification. 
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Techniques to reduce this overhead in- 
clude incremental compiling. The earliest 
work on incremental compiling was by 
Lock, (Lock, 1965), who describes a method 
of editing Algol 60 programs at the state- 
ment level. This allows for syntactic error 
detection and correction as each statement 
is entered. Semantic checking is left until 
run-time. The interactive Algol system 
CONA, (Atkinson & McGregor, 1978), was 
developed for use in an introductory pro- 
gramming course and involved complete 
recompilation of the source code. The au- 
thors reported that the resulting overhead 
imposed wasquite acceptable to the novice 
users but not for sophisticated users. In an 
attempt to reduce the overhead, further 
work was undertaken to develop a form of 
incremental compiling using context sensi- 
tive editing with a structure editor, (Atkin- 
son et al, 1981). A more flexible approach to 
incremental parsing allowing for modifica- 
tions of any form is presented by Ghezzi 
and Mandrioli, (Ghezzi & Mandrioli, 1979). 
However, the flexibility gained in the edit- 
ing unit is at the expense of the storage and 
maintenance of significant amounts of in- 
formation. To avoid recompilation, the 
scope of each statement and variable must 
be maintained to determine the range of 
effect a modification will have. 

Teaching novices programming 

An excellent source of information con- 
cerning the va/ious aspects involved with 
teaching novices programming can be 
found in the report by du Boulay and 
O'Shea, (du Eoulay & CShea, 1980). The 
report is a comprehensive literature review 
on the topic up to 1980. Findings presented 
include ideas on system use like: not to 
underestimate the amcunt of effort a nov- 
ice user may require t:> master a system, 
and statistics concernir g the major sources 
of errors in a programming language, e.g. 
the most e*Tor-prone construct in Pascal 
was the semi-colon. Some reservations are 
expressed concerning the lack of signifi- 
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cant progress made towards predictive 
theories about the programming process 
and that much of the data collected about 
novice programmers varies significantly 
depending on the language used and the 
environment in which testing was carried 
out. They conclude with: 

Bearing in mind these reservations, it 
is clear that all aspects of program- 
ming cause novices difficulty, includ- 
ing typing, planr ang, coding, testing 
and debugging. Many novices are 
frightened away right at the start by 
the amount of arbitrary detailed infor- 
mation that they have to remember, as 
well as the problems of typing accu- 
rately and quickly. Languages in 
which the novice can very quickly start 
writing and running interesting pro- 
grams (e.g. LOGO) have a definite 
advantage in that early success breeds 
confidence, (du Boulay & O'Shea, 
1980). 

These principles can be applied to many 
other categories of users, not just novices. 

Suggestion Generation 

Work on suggestio n genera tion began wi th 
early work on error-correcting compilers, 
(Aho & Peterson, 1972; Graham & 
Rhodes,1975 ; Kantorowitz & Laor, 1986; 
Moura, 1986; Feycock & Lazarus, 1976; 
James & Partridge, 1973). The techniques 
described in this paper most closely re- 
semble ideas from James & Partridge. They 
represent a method of representing the 
terminal symbols of a grammar as a tree 
and perform an attempted match of the 
input statement's tree to the correct form's 
tree. One interesting technique also pre- 
sented is the confidence jump that allows 
the parser to 'jump to a conclusion' based 
on a partial match to a certain degree. This 
could lead to an erroneous intention diag- 
nosis and if returned to the user asa sugges- 
tion, it could be misleading. However, 
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erroneous intention diagnosis and result- 
ingsuggestioncanof tenindicate the source 
of the error to the user. 

Requirements Specification 

The following requirements were identi- 
fied and specified before a design was 
initiated. 

a. Syntactic and semantic check as the 
code is entered. 

b. Suggestions provided when the system 
can anticipate the user's intent. 

c. Force corrections to be made as the er- 
rors occur. 

d. Afilesystemtosaveworkinprogressas 
weli as finished programs. 

e. The ability to save procedures and func- 
tions separately to build a library of 
routines for later use. 

f. To allow the delay of procedure and 
function declarations. 

g. Offer dynamic help with examples and 
rules. 

h. Menu driven user interface. 

i. Use independent windows for display 
of input /output. 

j. The ability to trace code and variables 
during 'simulated' execution using 
breakpoints and watchpoints. 

k. Automatic insertion of variable declara- 
tions. 

1. Automatic indentation at various block 
levels. 

m. The ability to test a procedure or func- 
tion independently. 

n. Detect run-time errors during simu- 
lated execution. 

The user is assumed to be a novice pro- 
grammer learning the programming lan- 
guage Pascal. No previous programming 
experience is assumed. It would help if the 
user has had a single tutorial on using the 
Macintosh prior to their first session with 
the system. 

Design Principles 

The system was designed using top-down 
principles combined with the advantages 

O 

ERLC 



93 

from prototyping and successive versions. 
At all times we maintain a system that runs 
and is therefore testable while only offering 
a limited subset of the projected capabili- 
ties. This makes the project continually 
exciting to the developers because we al- 
ways have something real to work with, 
instead of a simulation of 'what it is going 
to be like'. Successive versions have the 
added advantage of continually testing the 
existing software and design principles 
under new circumstances. This helps to 
remove many otherwise unobtrusive er- 
rors. Also, we managed to discover how 
the use f interface principles and assump- 
tions worked out over a long period of time 
(1 yr.). An idea for a response mechanism, 
like mouse click, may sound like a good 
idea at the start, but repeated use can illu- 
minate the frustration that can occur. 

The basic system was broken down into the 
following modules, (see fig.l), User Inter- 
face, Editor, Command Processor, Run- 
time Controller, Lex/Parse and Encoder/ 
Decoder. This breakdown minimized the 
area of effect of the Macintosh specific fea- 
tures, the toolbox routines in particulai 
These machine dependent peculiarities 
were confined to the Editor and User Inter- 
face modules, a technique known as infor- 
mation hiding, (Parnas, 1972). Information 
hiding permits the independent develop- 
ment of modules, a useful software engi- 
neering technique, while also encapsulat- 
ing details in one area thereby minimizing 
the effects of changes in other modules. 
Using this technique and porting the soft- 
ware to another machine implies that 
modifications will be restricted to the 
module containing the machino dependent 
details. 

The Editor and User Interface modules 
were developed first resulting in a working 
editor. We then used this editor in our first 
year class as a simple editor for entering 
programs into MacPascal. This gave us on- 
site testing by the actual users of the system 
enabling us to compile feedback on design 
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issues much earlier than if we had waited to 
release the final version of the system. The 
next module under development is Lex/ 
Parse. This involves thf lexical analysis and 
parsing of the Pascal source statements en- 
tered by the user. The lexical analyser was 
originally developed using Lex, (Lesk & 
Schmidt, 1975), under Unix by specifying a 
set of regular expressions to describe the 
syntactical elements of Pascal. The output 
from Lex was a working lexical analyzer 
which was then modified to work on the 
Macintosh under Lightspeed C and our 
environment. This method of development 
proved to be useful due to the increased 
speed and versatility of Unix on a Microvax 
II with spare capacity, however, a unified 
development envirenment has some obvi- 
ous advantages. All development would 
have taken place on the Macintosh if Unix 
had been available. 

The development of the Lex/Parse module 
is incremental, implementing one gram- 



matical category at a time. This allows for 
continual testing and the maintaining of a 
working environment at all times. Work 
on the Suggestion Generator module is 
proceeding in parallel with the Lex/Parse 
module. This is facilitated by the strong 
relationship between the original parse 
and the method of generating a sugges- 
tion as discussed later. 

Description of the major features of 
the environment 

Immediate detection of syntactic and seman- 
tic mors: 

A user enters a series of Pascal source 
statements into the system to create a 
program. As each statement is entered, it 
is parsed by the incremental compiler to 
determine if the statement is constructed 
in a valid form. This will detect any syn- 
tactic, and some semantic errors present in 
the statement. If any errors are detected, 
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the user is informed and must correct them 
before being allowed to continue. This 
ensures that the code en tered so far, is error 
free as far as the parser is concerned. If the 
system can anticipate the user's intent from 
an erroneous statement, a suggestion is 
generated and presented to the user for 
acceptance or rejection. If the user deletes 
any code from the program so far, the sys- 
tem will check this deletion for any errors 
introduced into the remaining code. 
Again, the user is notified and suggestions 
are generated if possible. 

ProcedurelfuncHon testing and saving: 

Students taking an introductory course in 
computer science are often taught to de- 
velop their software in a top-down manner. 
This involves the continual refinement of 
modules and routines. The Pascal pro- 
gramming language is often used to teach 
introductory programming skills, how- 
ever, Pascal requires that all routines be 
declared before their usage. This requires 
bottom up implementation for a piece of 
software that was usually conceived in a 
top down fashion. This anomaly is often 
the source of confusion in many novice 
programmers. They are required to worry 
about all tl <? details beforegetting the over- 
all process correct. One alternative is to use 
stubs, merely a place holder, for routines at 
a lower level, returning to define them in 
detail later. The MacTutor environment 
provides another alternative, thisbeingthe 
ability to use a routine call without defining 
the body of the routine first. A list of 
routines that need to be declared before a 
program is complete is kept. The user may 
test routines individually as well. A test 
shell is provided to specify the parameters 
required for a routineand then simulate the 
execution of the routine. This feature al- 
lows the user to test usinga bottom up, top 
down approach or both, depending on the 
user'spreference. This provides a means to 
allow the user to develop their programs in 
a form that directly corresponds to their 



personal conceptual form. The last feature 
is the ability to save routines in a library for 
later re-use. This feature should bebrought 
into context though, in that Pascal routines 
are very difficult to use in two different 
environments due to the strong typing in 
the language but this does not make re-use 
impossible. 

Simulating execution: 

An extremely effective method for a user to 
discover errors is to actually run their pro- 
gram. The problem with conventional 
compiler environments is that a run is ac- 
complished independently from the edit- 
ing environment. Any errors that occur 
must De corrected by leaving the run time 
environment and entering the editing envi- 
ronment. The cycle of edit - compile - run is 
repeated until a correct program is 
achieved. One advantage of a self con- 
tained developmfent environment is the 
ability to switch from one function to an- 
other immediately. Another advantage is 
to be able to control the execution of the 
code segment and stop and examine vari- 
able contents at the user's discretion. 
MacTutor includes the ability for a user to 
define where they would like a simulated 
execution to suspend and wait for further 
commands through the use of breakpoints 
and watchpoints. A breakpoint is associ- 
ated with a source code statement. When 
the run time controller encounters this 
statement, execution is suspended until the 
user chooses to continue. A watchpoint 
causes execution to pause when a certain 
variable is modified. Another function is 
the ability to trace certain variables 
throughout the program execution. The 
contents of the specified variables are dis- 
played in a window at all times with the 
appropriate modifications being made as 
they occur. The user also has the ability to 
step the run time controller through the 
source code one statement at a time using 
the single stepping function. These tools 
give the user a very effective method to 
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trace the program's execution under vari- 
ous conditions and inputs. Program de- 
bugging becomes an enjoyable and infor- 
mative task while also being efficient. 
Using these techniques, a user can discover 
many logic and semantic errors that would 
otherwise have taken many runs with a 
substantial amount of 'guessing' as to the 
appropriate correction to make. 

Suggestion generation and help: 

When a user makes an error, the system 
attempts to determine the original intent 
and suggest a correction. The user is given 
the opportunity to accept or reject this 
suggestion. A user's statement is parsed 
and a partial parse tree is constructed. This 
is analyzed to detect any errors. If an error 
is detected a nearest match is attempted 
with a correct partial parse tree segment 
stored in the system. The closest match 
'esembling a correct structure is used to try 
to reconstruct the user's partial parse Lee 
segment. This is then traversed to generate 
the suggestion. The details of this method 
are fairly technical and are thus beyond the 
scope of this paper. It is not possible to 
always generate a suggestion as the omis- 
sions from the user's entry makes identifi- 
cation of the intent a guess at best. In this 
case the system will identify the error to the 
user as per a typical compiler, requesting 
the user to correct before continuing. 

Static help systems fail to take into account 
the previous history of the particular users. 
Users must understand a substantial 
amount of the problem area to ask for the 
correct kind of help. A profile could be 
maintained for each user that would record 
the usage of both the features of the envi- 
ronment used and of the syntactic con- 
structs mastered in the language. Using 
this profile, help can be offered in an incre- 
mental way. To the complete novice an 
obtrusive help system is active making 
suggestions at each fault of the user. As the 
user accomplishes tasks within the envi- 
O 
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ronment, the help system can take more of 
a back seat and wait to be asked for assis- 
tance. This would provide a model closer 
to the environment existing between a 
novice user and a human tutor. Of course 
the ultimate machine based environment 
would incorporate a complete history of 
the user and use this to generate intelligent 
prompting, correcting and encouragement 
by anticipating theerrorsand pitfallsof the 
users. The substantial overhead imposed 
by such an undertaking does not imply 
that steps towards this goal should not be 
taken. A useful environment can be cre- 
ated using a modified history of each user 
to generate assistance in the form of sug- 
gested corrections and examples using the 
user's incorrect and correct statements, 
(for a more detailed description of the 
application of an intelligent help system, 
see Waugh & Stark, 1 987.) 

Editing capabilities: 

The editor allows a user to enter Pascal 
programs which can consist of Pascal state- 
ments and comments in the form of English 
text. The editor provides the useful fea- 
tures of automatic indentation in block 
levels resulting in a pleasing visual presen- 
tation of the code. Other features include 
the ability to cut and paste, use the clip- 
board to make copies of code for duplica- 
tion purposes or moving text around and 
scrolling both up and down the page as 
well as left and right a? the page size is 120 
columns wide. Other useful functions in- 
cludesaving of files, resuming apreviously 
saved session and undoing previous com- 
mands. 

The user interface: 

The user interface is menu driven with 
independent windows, (see fig. 2), forcode, 
program output, variable tracing and 
communications between the user and the 
system, (known as dialogue boxes on the 
Macintosh). The interface was designed to 
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Figure 2 



take advantage of as many features of the 
Macintosh toolbox as possible. This allows 
for a clean, simple and efficient interface 
All interactions involve some form of indi- 
cation using the mouse or typing using the 
keyboard cr menu selection. The amount 
of typing required by the user is thus mini- 
mized. Many users enjoy the novelty and 
ease of use of a Macintosh, especially when 
compared to the alternative systems of- 
fered by typical operating systems. 

Conclusions 

In this paper a truly useful Programming 
Environment for novice programming 
students has been described. The method 
of implementation has also been presented 
with the advantages and lessons learned 
along the way. The major outcome of the 
whole undertaking has been the idea to 
generate a Programming Environment 
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shell that is independent of any particular 
programming language. Implementations 
would include a language dependent 
module being 'plugged' into the shell re- 
sulting in a novice Programming Environ- 
ment for any language that a language 
module exists. This is a rather ambitious 
undertaking and is the direction of future 
research. Other extensions are to include 
dynamic data flow analysis. Basically, data 
flow analysis provides a trace of the use 
and abuse of variables, an example being 
re-initialising an unreferenced variable, 
allowing the detection of anomalies in 
variable usage which can be corrected to 
provide a more efficient and less error 
prone program. Dynamic data flow analy- 
sis is analysis performed while the pro- 
gram is being created and compiled. This 
last feature can be accomplished with 
minimal modifications to the existing envi- 
ronment. 
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Finally, the environment and its tools can 
be extended to the professional develop- 
ment arena. This would require the optimi- 
zation of every facet of the environment as 
professional software development is not 
concerned with teaching programming, 
only the development of software, pro- 
gramming environments, and automated 
software engineering tools in general, are 
gaining much enthusiasm as software con- 
tinues to become larger and more complex. 

A closing thought: 

'Least is most 7 

Mies van der Rohe. 

(especially when applied to the amount of 
information a programmer needs to keep 
in their head and the amount of effort to 
achieve the end result.) 
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Courseware abstraction is an approach to CAL 
whereby the lesson author creates a general 
parameterised CAL lesson that is then applied 
<o many concrete examples. This approach has 
the following advantages — 

• it provides a powerful framework within 
which to adapt tuition to a student's 
knowledge and aptitude; 

• it encourages the development of detailed 
treatments of the subject matter; 

• it reduces the cost of lesson development 
as a ratio to student lesson time; and 

• it enables large numbers of examples to be 
made available for individual students. 

Generative CAL is an example of courseware 
abstraction. It is argued mat the advantages of 
generative CAL do not arise directly from the 
generation of the examples to be examined but 
rather can be directly attributed to the use of 
courseware abstraction. 



with the capacity to generate, solve and 
critique students' solutions to novel prob- 
lems. Once one leaves the domain of 
mathematics, relatively difficult AI based 
techniques are required to create genera- 
tive CAL. (See, for example, Sleeman and 
Brown, 1982). 

Generative CAL offers several 
benefits — 

• By selecting problems with appropriate 
attributes it is readily possible to adapt 
to variations in student's initial compe- 
tence and learning rate within a do- 
main. 



Generative computer-aided learning is a 
CAL technique that was developed in the 
late sixties (Uttal, Pasich, Rogers & Hiero- 
nymous, 1969; Uhr, 1969). A generative 
CAL system generates unique problems 
and presents these to the student for solu- 
tion. The system must be able to evaluate 
and critique the student's solution to the 
problem. This implies that the problems to 
be generated belong to a class of problems 
for \ 'hich the system has the capacity to 
generate, evaluate and critique novel in- 
stances. 

Most generative CAL systems have been in 
the domain of rr~ \ematics. This is not a 
matter of coin jnce. Mathematics is one 
of the few domains for which it is relatively 
simple for the computer to be provided 
O 



• Because one general treatment of a 
domain is defined that is then applied to 
many instances from that domain, the 
lesson author is encouraged to make the 
treatment more detailed than if a sepa- 
rate treatment has to be written for each 
example to be examined as is the case 
with normal programmed learning. 

• Because only the one general treatment 
has to be written, if the system is able to 
generate many examples from the 
domain and consequently the one gen- 
eral treatment is presented to the stu- 
dent a large number of times then the 
relative cost in authoring time to stu- 
dent terminal time is likely to be very 
low. This can make the approach very 
cost effective. 
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• The student is provided with the oppor- 
tunity to examine as many problems as 
may prove desirable, all within the one 
consistent framework. 

However, a careful examination of these 
benefits will show that none of them result 
directly from the fact that the computer 
generates the problems to be examined. 
Rather, they result from the fact that one 
general treatment of a domain is applied to 
many specific instances from that domain. 
In short, the benefits of generative C AL all 
arise from the fact that it is a technique that 
employs an approach to creating CAL that 
will be referred to as courseware abstraction. 

Courseware abstraction is a method of 
creating computer-based courseware that 
is both time saving for the lesson author 
and encourages thorough treatment of the 
subject matter. The author creates once 
only a detailed abstract CAL treatment of 
the subject matter. This treatment is par- 
ameterised. That is, those aspect? of the 
subject matter that change from example to 
example are identified, and a variable is 
provided for each. This parameterised 
abstract treatment is then applied to a body 
of specific examples from the subject area. 
Associated with each example are the cor- 
rect values for that example for each pa- 
rameter in the abstract treatment. The re- 
sult is a detailed treatment of the particular 
exampleforthestudent. The one lesson can 
then be presented to the student many 
times, each time using a different example 
and providing a relevant analysis for that 
example. 

Generative CAL is one approach to CAL 
that employs courseware abstraction. The 
vast majority of generative CAL systems 
have been for mathematics. As stated 
above, this is not a matter of coincidence. 

Generative CAL systems must meet the 
following requirements. 
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• They must be able to generate meaning- 
ful problems. 

• They must be able to solve the problems 
generated. 

• They must be able to monitor, remedi- 
ate and assist the students' attempts to 
solve the problems generated. 

As mentioned above, although this is rea- 
sonably tractable for arithmetic domains, 
once one leaves the field of mathematics 
very sophisticated artificial intelligence 
based systems are required. The develop- 
ment and operating overheads of such 
systems are prohibitive for most CAL ap- 
plications. 

However, courseware abstraction does not 
require that the system should generate the 
problems that the student is to examine. 
Rather, the course author can create a body 
of examples that the system can then use, 
thus avoiding the problem of generating 
novel problems. This approach has been 
used with success by a number of systems. 
Itis a key factor in thepqwercf theECCLES 
(Richards & Webb, 1985) and DABIS 
(Webb, 1986) systems. Most AI based CAL 
systemsutiliseit. Despite being a key factor 
in many systems, this approach to CAL has 
not previously been identified and the role 
that it plays has not previously been recog- 
nised. 

As the generative approach has been well 
documented, the rest of this paper will 
address non-generative approaches to 
courseware abstraction. To provide a con- 
text for this discussion the next section 
examines a typical example of an applica- 
tion for courseware abstraction—-CAL 
treatments of the French pass£ compost. 
The remaining sections provide a general 
discussion of the advantages and applica- 
bility of the approach and means of imple- 
menting it in existing CAL languages. 
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A computer-based lesson on the 
French passt compost 

The pass6 compost — the past tense verb 
agreement system— is an extremely diffi- 
cult aspect of French grammar. The past 
tense is marked by the presence in a phrase 
of one of the auxiliary verbs etre and avoir. 
Each verb can normally only appear with 
one of these auxiliary verbs. This aspect of 
French grammar has many irregularities. 
That is, for many French verbs it is not 
obvious which auxiliary verb the main 
verb takes. This is simply a matter of ac- 
quired knowledge. 

The agreement rules of the pass6 compost 
can be summarised as follows — 

• If there is a reflexive pronoun in the 
phrase as either the direct or indirect 
subject of the main verb then— 

• If the reflexive pronoun is the direct 
object of the main verb then the verb and 
direct object must agree in both number 
and gender. If the reflexive pronoun is 
the indirect object of a pronominal main 
verb then the verb must usually be 
unmarked for both number a nd gender. 
This means that it takes the masculine 
singular form. (The reflexive pronoun 
is treated here as the direct object of the 
verb in phrases such as Elle s'est lavee 
but not in phrases such as Elk s'est lavi 
les mains.) 

• Irrespective of whichauxiliary verb the 
main verb normally takes, the phrase 
must contain the auxiliary verb etre. 

• If there is no reflexive pronoun in a 
phrase and the main verb takes the 
auxiliary verb etre then it must always 
agree with the subject of the phrase in 
both number and gender. 




• If a main verb takes the auxiliary verb 
avoir and there is a direct object in the 
phrase that precedes the main verb then 
the main verb must agree with it in both 
number and gender. If there is no direct 
object, or if the direct object follows the 
verb then the main verb must be un- 
marked for both number and gender. 

To further complicate matters, the auxil- 
iary verbs etre and avoir take many differ- 
ent forms depending upon their context, 
making it difficult for the student to iden- 
tify whether they are present. 

From the complexity of the above descrip- 
tion it should come as no surprise that 
students of French grammar typically ex- 
perience great difficulty in mastering this 
aspect of the grammar. It is clearly of 
benefit to students to provide them with 
practical experience in identifying whether 
particular French phrases do conform to 
these rules and, if not, how exactly they 
conflict. In short, this aspect of French 
grammar is a prime target for CAL. 

The only practical manner in which to 
provide this practice is to create a large 
series of exercises, E v E v ... E n , each of which 
examines a separate French phrase, P., such 
that E. examines P r 

The standard test and branch approach to 
the authoring of such a lesson is to create a 
list of example phrases to be examined and 
for each of these examples write a CAL 
segment that provides a detailed exercise 
examining that example. This will be called 
the traditional approach. This approach can 
be characterised as the creation of CAL 
segments s,, s 2 , ... s K such that $ { generates 
the interactions with the student required 
by E r As a result, the provision of n exer- 
cises will require the creation of n CAL 
segments. 
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It would be necessary in such a lesson to 
examine the following questions, among 
others, with relation to the examples — 

• Is the phrase grammatical? 

• What is its main verb? 

• What is its auxiliary verb? 

• Does the main verb agree with its sub- 
ject? 

• Does the main verb agree with its direct 
object? 

• What is the main verb's number? 

• What is the main verb's gender? 

• Does the main verb have a direct or 
indirect object? 

• Does the direct object precede or follow 
the main verb? 

• Does the phrase contain a reflexive 
pronoun? 

However, not all of these questions would 
apply to all of the examples. For example, 
it would only be important to determine 
the relative location of the direct object and 
main verb of a phrase if the main verb took 
avoir. 

Each exercise would have to examine only 
those questions that are relevant to the 
example on which it is based. Each relevant 
question would be asked of the student. 
The student's answers would be evaluated 
and appropriate feedback provided. 

The structure that each exercise might take 
would be to first enquire of the student 
whether s/he believes the example to be 
grammatical. If the student answers cor- 
rectly then it can be assumed that s/he can 
correctly analyse the example and another 
example can be selected and examined. If 
this assumption is incorrect and s/he has 
only guessed the correct answer, this 
would be picked up at a later stage when s/ 
he again has to analyse a similar phrase. 



If the student believes that the example is 
ungrammatical and it is not, each of the 
reasons why it could be ungrammatical 
should be examined and the student 
should be shown how they do not apply to 
the example. Conversely, if the student 
believes that the phrase is grammatical and 
it is ungrammatical, then s/he should be 
shown exactly how it is ungrammatical. 
Figure 1 shows a fragment of such an 
example exercise written in Common Pilot. 
This fragment tests if the student can iden- 
tify the direct object in the phrase Jeanne je 
I'aivuehier. Common PILOT is described in 
Khieraty & Gerhold (1980). 



R: Examine whether there is a direct 

object in the phrase. 
T: Is there a direct object in 

"Jeanne je l'ai vue hier"? 
U: ANSYES 

TY: Yes, well done! 

TN: Wrong, "L"' is the direct object 

in this phrase. 
JN: 6P 
T: 

T: What is the direct object in 
"Jeanne je l'ai vue hier"? 

A: 

M:%L'% 

TY: Very good! 
JY: AGREE 
M:%JE% 

TY: No, W JE" is the subject of this 
phrase. 

TY: The direct object is "L"'! 
TN: No, the direct object in this 

phrase is W L'" 
*AGREE 

ANSYES is a subroutine that sets the Y conditioner 
if the student gives an affirmative response and sets 
the N conditioner for a negative response. 



FIGURE 1: A fragment of a standard test 
and branch lesson on the French passe 
compose 
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Let us assume that we are going to provide 
one hundred exercises for the student. This 
is far fewer than would be desirable, but it 
will do to demonstrate the point. 

For each exercise there will be a complex 
schedule of— 

• frames of text to be displayed to the 
student; 

• questions to be asked of the student; 

• answer evaluation procedures to apply 
to the student's responses; and 

• conditional branching dependent upon 
the student's responses. 

There will be some similarities in this 
schedule from exercise to exercise, in that 
the text frames, questions and answer 
evaluation procedures will be drawn from 
one pool, but the exact set used will vary 
greatly from exercise to exercise. 

If the traditional approach were used each 
of these exercises would have to be au- 
thored as separate CAL segments. Cer- 
tainly, there would be some savings in 
authoring time — due to being able to copy 
frames, answer evaluation procedures, etc 
from one exercise to the next — but each 
exercise would still have to be separately 
manually constructed by the author. 

It is probable that each CAL segment 
would take at least 100 minutes to author. 
Assuming that each exercise would occupy 
approximately 1 minute of the student's 
time, as each exercise is embodied in a 
separate CAL segment, this results in an 
authoring ratio of 100:1. This estimate is 
probably quite conservative. A ratio of 200 
authoring hours to one student hour is not 
uncommon for this authoring methodol- 
ogy- 

On these figures, for 100 exercises the au- 
thor could expect to spend 10,000 minutes, 



or approximately 165 hours. All of this for 
1 hour and 40 minutes of student lesson 
time! This amount of time might be feasible 
for a software house, but it certainly is not 
for a teacher wanting to provide some 
remedial exercises for a few students! 

This would be a prime target for generative 
CAL if only it were possible for the com- 
puter to generate novel examples and to 
determine the correct analyses for those 
examples. The creation of such a system 
may be currently feasible using state of the 
art artificial intelligence programming. 
However, the developmental cost involved 
would almost certainly far exceed that of 
the traditional approach. 

The alternative approach that is being pro- 
posed is to write once only some general- 
ised courseware which can then be used to 
examine any of a large number of concrete 
examples from the domain in question. 
This can be described as the creation of a 
single CAL segment Sti), which takes as a 
parameter a description of the item to be 
examined, and generates the appropriate 
exercise for the student, E t In the case of the 
French pass£ compost this means writing a 
lesson that can examine any combination of 
verb type and agreement (or lack of agree- 
ment) for any phrase. Such a lesson has all 
the advantagesof a generative system with 
the added bonus that it is feasible to imple- 
ment! 

Figure 2 contains a portion of an example 
lesson which utilises this approach, again 
written in Common Pilot. The code in 
Figure 2 is a subroutine which examines 
whether the student can identify the direct 
object in a phrase. This lesson fragment is 
functionally identical to that in Figure 1. 
That is, given that the fragment in Figure 2 
is being applied to the phrase examined in 
Figure 1, both respond identically to the 
student. Despite the fact that the abstracted 
code can be used in examining any phrase, 
it is less than twice the size of the traditional 
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code which can only be used to examine 
one particular phrase. The greater utility of 
the abstracted code is gained at very little 
cost. 

*EXAMDO 
R: 

R: Examine whether there is a direct 

object in the phrase. 
T: Is there a direct object in n $A$ 

n ? 

U: ANSYES 

J(D$ - : NODO 

*DO 

TY: Yes, well done! 

TN: Wrong, *$D$ * is the direct 

object in this phrase. 
EN: NEXTPH 
T: 

T: What is the direct object in W $A$ 
« ? 

A: 

T(%B - D$) : Very good! 
EC: 

T(%B - E$ & E$ <> No, *$E$ * is 

the indirect object. 
TC: "$D$ " is the direct object! 
EC: 

T(%B - C$): No, *$C$ w is the subject 

of this phrase. 
TC: The direct object is "$D$ w ! 
EC: 

T: No, the direct object in this 
phrase is *$D$ * 

E: 

*NODO 

TN: Excellent! 

TY: Wrong. There is no direct object 

for this phrase. 
EY: NEXTPH 
E: 

ANSYES is a subroutine that sets the Y conditioner 
if the student gives an affirmative response and sets 
the N conditioner for a negative response. 

C is the subject of the phrase. 

D is the direct object of the phrase. 

E is the indirect object of the phrase. 

FIGURE 2: A fragment of an abstracted 
lesson on the French passe compost 



Clearly the abstracted courseware requires 
some means of determining the details of 
the concrete example under consideration. 
Otherwise it cannot determine what the 
correct answers are for any particular ex- 
ample phrase. The lesson from which the 
fragment in Figure 2 is taken reads the 
phrase and various parameters about it in 
from a file. Figure 3 shows the parameters 
that are read in for exercises on the phrases 
Jeanne je Vai vue hier and Nous nous sommes 
arrites devant la bibHothfyue. 



Phrase 



Jeanne je Vai 

Nous nous sommes arrites 
vue hier devant la btbliothique 



Grammatically GRAMMATICAL OVMdSOL 

Subject je nous 

Direct Object /' nous 

Indirect Object la 
bibliothique 

Reflexive Pronoun nous 

Verb vu arrites 

Auxiliary Verb avoir Stre 

Location of direct object PRECEDING H&KX43 

Number SINGULAR PLURAL 

Gender FEMININE MA&LttE 



FIGURE 3: Parameters for two examples 
from the abstracted pass£ compose 
lesson. 

Using this authoring method, if we assume 
tliat it will take the author approximately 
40 hours to specify th<^ initial lesson and 
then approximately 1 minute to specify 
each example phrase and its parameters, 
then we have an authoring time of 2500 
minutes for the lesson with 100 examples. 
This is an authoring ratio of 25:1/ a fourfold 
improvement over the traditional ap- 
proach. It is not really important whether 
the (probably already excessive) figure of 
40 hours for the specification of the ab- 
stracted lesson is not accepted. No matter 
how exorbitantly this figure is inflated, the 
ratio will still come out in favour of course- 
ware abstraction in the long run. This is 
because, having written the abstracted les- 
son and being in the position that each new 
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phrase only takes a minute to specify, the 
author is unlikely to stop at one hundred 
examples. The more examples that are 
specified, the better the authoring ratio will 
be. This contrasts sharply with the tradi- 
tional approach where the authoring ratio 
remains constant no matter how many 
examples are provided. 

Several points should be noted about the 
lessons of which portions appear in Figures 
1 and 2. First, as already mentioned, for the 
phrases covered by the traditional lesson, 
both lessons are functionally identical. The 
traditional lesson only covers three 
phrases. However, with just these three 
phrases the author has already written less 
code (albeit more complex) for the ab- 
stracted lesson than for the traditional one. 
Further, the smaller abstracted lesson can 
already handle far more than just the three 
examples that the traditional lesson 
handles. Indeed, the abstracted lesson can 
handle any grammatical phrase with a re- 
flexive pronoun as the direct object or with 
a main verb that takes avoir. All that is now 
needed to make the abstracted lesson 
complete are short treatments of phrases 
with reflexive pronouns as indirect objects 
and of verbs that take etre and a treatment 
of ungrammatical sentences. The latter 
would be approximately the same size 
again as the existing lesson code. By com- 
parison, the task of the author using the 
traditional methodology has barely begun 
with the three phrase example which has 
been written. 

The final point that should be made about 
the example lessons is that it is not impor- 
tant whether the reader believes that they 
provide a good or a bad treatment of the 
subject matter. They are provided only to 
serve as a concrete example of the differ- 
ence between abstracted and non-ab- 
stracted courseware. Courseware abstrac- 
tion isnot tied to this programmed learning 
based style of lesson. For example, the 
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GREATERP system involves the applica- 
tion of a general lesson to a sequence of 
concrete examples. Thus, it is also an ab- 
stracted lesson. However, it clearly does 
not use a programmed learning based 
approach to CAL. Rather, it utilises ex- 
tremely sophisticated AI based CAL. 

The advantages of courseware abstrac- 
tion 

An improved ratio of authoring to student 
time is just one of the advantages of course- 
ware abstraction. 

Lesson validation is far easier with ab- 
stracted courseware. With the traditional 
approach, the author will never be able to 
thoroughly determine that no errors lie 
hidden in some section of code in some 
exercise or other. With courseware abstrac- 
tion, any error in the abstracted courseware 
will quickly come to light, as the same code 
is used for every exercise. Once the gener- 
alised lesson has been debugged, the entire 
course can easily be validated simply by 
checking that the parameters passed into 
the system are correct. If the parameters 
have been given sensible names then this is 
straight forward. The author need only 
scan through a list like that in Figure 3 in 
which any errors will be transparently 
obvious. 

Another advantage of the methodology is 
that it encourages the author to provide an 
exhaustive treatment of the topic. With the 
traditional approach the author knows that 
for every aspect that is built into the lesson 
there is going to have to be separate code 
written for each example to which it ap- 
plies. Thiscan result in the author having to 
choose between providing a thorough 
treatment of a smaller than desirable set of 
examples, or a less thorough than desirable 
treatment of a larger body of examples. 
This is not true with abstracted courseware 
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authoring because the author only has to 
provide the one thorough treatment of the 
domain. This is then applied to all ex- 
amples examined thus ensuring that every 
example receives the same level 01 analysis. 

Abstracted courseware is also easier to 
update. If the author decides that some 
aspect of the original treatment of the 
domain under examination should be 
changed, such a change need only occur in 
one place in the generalised lesson. Under 
the traditional approach, any such change 
would need to be made separately for each 
exercise to which it applied. This would 
cause two problems— a) determining 
which exercises the change applies to; and 
b) changing the lesson code in each exer- 
cise. 

Another advantage of courseware abstrac- 
tion is that it provides a framework in 
which it is readily possible to adapt instruc- 
tion to each studenfscuirent level of exper- 
tise in a domain. If the CAL system is able 
to identify relevant features of the ex- 
amples that it is examining, such as their 
relative difficulty, and isable to judge from 
the student's performance how well they 
perform in relation to these f eatures, then it 
is relatively straight forward to select ex- 
amples for examination that are appropri- 
ate for the student's current needs. For 
instance, if the examples are graded with 
regard to difficulty, and the system can 
determine that the student makes no errors 
when examining examples at difficulty 
level one, makes errors for 50% of the ex- 
amples at difficulty level two and 90% of 
the examples at difficulty level three then it 
will be able to determine that it should 
concentrate on examples at difficulty level 
two. All that it need do is start at the easiest 
difficulty.level and work its way down to 
the more difficult levels, remaining at each 
difficulty level until the student achieves a 
set success rate. 



But difficulty level is not the only or the 
most powerful distinguishing feature that 
could be taken into account. Consider the 
abstracted pass6 compost lesson. If the 
student is not making errors for examples 
that take the auxiliary verb avoir but is for 
examples that take the auxiliary verb itre, 
then it will be quite trivial for the system to 
identify this fact and to concentrate on the 
examples for which the student needs fur- 
ther tuition— those which take the auxil- 
iary verb etre. All of the information that it 
needs in order to determine this— that is, 
the auxiliary verb for each example— is 
already explicitly stated and thus readily 
accessible. 

A final advantage of abstracted courseware 
is that it greatly facilitates the analysis of a 
■studenf sperformanceduring the lesson. If 
a simple record is maintained of the ques- 
tions at which th? student makes mistakes, 
then it will be readily possible to determine 
what difficulties the student is experienc- 
ing. For instance, if the student often speci- 
fies the wrong word as being the main verb 
in the phrase then it is clear that they are 
having difficulty identifying the main verb. 
The standard test and branch approach 
makes this information far more difficult to 
obtain as there is no clearly defined struc- 
ture by which to assign identity to similar 
questions in different exercises. At best, 
this becomes another chore for the author 
to look after. At worst, this information is 
simpiy not collected. 

The applicability of courseware 
abstraction 

Courseware abstraction is clearly not a 
methodology that can advantageously be 
applied to ail domains for which a com- 
puter-based lesson may be written. Rather, 
courseware abstraction only comes into its 
own when large numbers of concrete ex- 
amples are to be examined in terms of a 
general theoretical framework. 
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An obvious area in which this applies is 
grammar. Typically languages have very 
complex grammatical systems for which it 
is advantageous for the student to examine 
large numbers of specific examples within 
a general framework. The passe compost 
lesson is an example of just one such lesson. 

However, languages are far from the only 
domains to which such lessons may be 
applied. A lesson has been developed 
under the DABIS system (Webb, 1986) that 
examines the leading theories in the mind/ 
body debate within philosophy. The lesson 
identifies a number of central questions 
within this debate and examines how each 
key positionin the debate hasa differentset 
of answers to these questions. 

Another possible use for the methodology 
is in the control of practical classes where 
the students must follow a strict order of 
enquiry to reach some conclusion. For 
instance, the students could be given a 
chemical solution and then the program 
could guide them through the step by step 
process of identifying its chemical compo- 
sition. The same lesson could inanage the 
examination of any of a large number of 
chemical solutions. 

Courseware abstraction is a methodology 
of wide but not unlimited application. 

Courseware abstraction in existing 
CAL systems 

As is demonstrated with the Common Pilot 
lesson from which the fragment in Figure 2 
is taken, courseware abstraction ispossible 
using at least some existing CAL lan- 
guages. 

All that is required for a CAL authoring 
system to allow courseware abstraction is 
for it to support some method of specifying 
variables and then assigning them differ- 
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ent values for different examples; and for it 
to allow conditional branching dependent 
upon the value of those variables. 

Probably the simplest way to implement 
this in most existing CAL languages would 
be the approach taken in the lesson frag- 
ment in Figure 2. That is, to define a set of 
variables which are then read in from a file. 
For each example that is presented a new 
set of values is read into the variables from 
the file. Once a lesson has been written, a 
text editor can then be used to create and 
update the input file. 

However, for courseware abstraction to be 
possible, it is not necessary for a CAL lan- 
guage to support files. If the language 
supports variables then it is possible sim- 
ply to assign values to them within the 
program. Thus, each time that an exercise 
begins a new set of values are assigned to 
the variables. 

Although courseware abstraction is pos- 
sible using many existing CAL languages, 
specialised systems, such as ECCLES 
(Richards & Webb, 1985) and DABIS 
(Webb, 1986), that take advantage of the 
special features of the methodology in- 
crease its benefits to the author. 

Conclusion 

Courseware abstraction provides a meth- 
odology for the authoring of computer- 
based courseware which can create de- 
tailed lessons of a type not feasible through 
other approaches due to their huge cost in 
authoring time and difficulties of mainte- 
nance. 

The benefits that courseware abstraction 
have to offer have already been demon- 
strated by the success of generative CAL. 
Among the attractive features of course- 
ware abstraction are reduced authoring 
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time; the provision of a convenient frame- 
work for adapting tuition to the student's 
level of expertise; improved lesson verifi- 
cation; improved lesson modifiability; and 
improved student analysis. 

Although courseware abstraction has been 
used in many previous C AL systems, there 
does not appear to have been any apprecia- 
tion of the fact that it was courseware ab- 
straction to which many of the desirable 
features of these systems could be attrib- 
uted, this is particularly notable in the case 
of generative C AL where the benef itsof the 
approach have been attributed to the gen- 
eration of the problems to be examined 
whereas they can actually be attributed to 
the use of courseware abstraction. 

It is to be hoped that a better understanding 
of factors underlying the success of these 
approaches will in turn lead to the develop- 
ment of yet better approaches. 
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2 Text-dominated instructional material 
usually defines and pi escribes the 
learning experience and seldom draws 
on the experience or potential of the 
learner. 

3 There is an assumption that self-moti- 
vation of the remote learner will help 
him or her overcome the lack of learn- 
ing resources. 

4 There is not enough understanding or 
appreciation that a remote learner may 
not have participated in a course for the 
sake of merely getting a qualification. 

A videotex-based AESNET 

King and Fostt/s chapter is in a book on 
study centres (Castro, Livingston and 
Northcott 1985) published in August 1985, 
the year that saw the launching of 
Australia's videotex system (Viatel), first 
satellite (Aussat), two public electronic 
messaging systems (Minerva and Tele- 
memo, now merged to form Keylink), and 
the year that the International Council of 
Distance Education held its Thirteenth 
World Conference at Melbourne. The Hon. 
Susan Ryan, then Minister of Education, in 
her opening address to the 600 delegates 
from around the world, announced the 
Government's "very important" commit- 
ment to Edutel, an educational network on 
Viatel. The vague expectations of the Gov- 
ernment and the external studies fraternity 
were that Edutel would develop into a 
national network like Prestel Education in 
the United Kingdom, and that it would 
have a comprehensive national course di- 
rectory which could be continuously up- 
dated by all participating institutons. In 
other words, there would be an Australian 
external studies network (abbreviated in 
this paper as AESNET) built on a publicly 
available and simple to use videotex sys- 
tem. Study centre personnel, by signing on 
to Viatel, would be able to show students 
the courses on offer, and perhaps even offer 
online counselling. 



Such expectations were never realised and 
it is unlikely that they will be. Videotex is a 
simple technology with a pleasing mixture 
of colour, graphics and text. Its menu ap- 
proach, numerical branching technigue, 
and split rate access (sending at 75 bps and 
receiving at 1200 bps) make it slow and 
cumbersome when compared with com- 
mand-driven systems. It is therefore not 
effective or efficient for large databases, 
mail and sophisticated information re- 
trieval; but is a promotional medium more 
suitable for business or commercial appli- 
cations. 

Most institutions and home-learners who 
rushed to subscribe to Viatel soon discov- 
ered its educational limitation and as a 
result, any ir ' 1 euphoria and enthusiasm 
towards a national network based on Viatel 
have vanished. There are also different 
environmental factors in Australia and the 
United Kingdom to account for the failure 
of educational videotex in the former and 
the relative success in the latter (Castro 
1986). So one could say that the notion of a 
videotex-based AESNET was virtually 
shelved earlier this year when the Govern- 
ment finally withdrew its limited support 
in early 1987 to the Australian Caption 
Centre, a non profit-making organisation 
appointed to develop Edutel. Edutel has 
since been sold to a commercial videotex 
bureau. Recent reports, however, inc J cate 
that the notion is back in vogue with the 
Commonwealth Tertiary Education Coir.- 
mission and some selected Technical and 
Further Education sites will be asked to 
develop and manage such a network for 
use by all external students and institu- 
tions. 

It would be useful, therefore, to pause at 
this point and ask what can such a network 
hope to achieve. Is it to replicate the current 
conventional support services which, in 
the view of King and Foster, are more di- 
rected to meeting just the needsof the insti- 
tution? Or should it try to provide ? coring 
and more efficient environment which 
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some would regard as beneficial for indi- 
vidual learning? 

These are difficult questions which do not 
seem to have been widely or seriously 
contemplated or addressed by people who 
have expert knowledge about the strengths 
and weaknesses of educational technolo- 
gies and, more importantly, an apprecia- 
tion of the crucial issues of the need for 
technology management and user educa- 
tion. While I certainly do not pretend to 
have all the answers and can only speak 
from limited, personal experience as an 
instructional designer, an on-line network 
manager, and a researcher of information 
technology, I do not subscribe to the view: 

• That an AESNE1 has to be based en- 
tirely on computer technology or even 
on a particular kind of system; and 

• That a nationally directed and managed 
network will attract a workable user 
base from within and outside the terti- 
ary institutions. 

The phibsophy of a home-based 
network for tertiary distance and open 
education 

A different philosophy, and in my view a 
more realistic approach, would have been 
to visualize the student support system as 
beginning at home - the home of the stu- 
dent and the home of the institution. If 
institutional decision is that a technology- 
based support system should complement 
the current conventional one, then I would 
propose a serious consideration of the fol- 
lowing four tasks: 

1 That there should be a thorough review 
of current computer resources within 
each institution to see if they could be 
integrated to provide a reasonable elec- 
tronic infra-structure of student sup- 
port. 

2 That this structure be managed by a 
small team of people who are techni- 



cally competent, can take on the role of 
a mentor and a catalyst, and who are 
personally committed about their 
facilitative and gatekeeping responsi- 
bilities towards the student users of 
such a network. 

3 That approaches be made to established 
and operational national, state and 
commercial networks (e.g. ACSNET, 
VICNET, CSIRONET and KEYUNK) 
to request for interconnection to institu- 
tionally-based networks to form a na- 
tional AESNET at some stage in the 
future. 

4 That an institution start training both 
staff and students to help them become 
effective users of the network. 

All four tasks have to proceed concurrently 
but criss-crossing in a timeline that may 
stretch to three, four or even five years. 

For the first task, I shall now quote some 
examples of using computer and telecom- 
munications technologies at Deakin Uni- 
versity. The purpose isnot to publicise how 
advanced Deakin University is but to draw 
attention to then fact that they are the sort of 
resources or embryonic services already 
existing in many tertiary institutions and 
which in time will be used by an increasing 
number of staff and students at a rate 
commensurate with how they are intro- 
duced or promoted. 

The following is a summary of the comput- 
ing resources at Deakin; machines and 
connections which are irrelevant to the 
current discussion have been omitted for 
the sake of clarity. 

1 Machines: 

• Charlie (Gould PN6080, UNIX central 
machine for academics and students) 

• Alice (Data General Eclipse S/160 for 
Library) 

• Microcomputers (app. 300 units in mi- 
crolabs and staff offices, mainly IBM- 
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compatibles tor Schools of Sciences. 
Management, Architecture and Li- 
brary; and Macintoshes for Schools of 
Education, Social Sciences, and Hu- 
manities) 

• Terminals (app. 300 units) 

2 Connections 

• The bigger machines and terminals are 
linked by cables to Micom and Ethernet 
ports. 

• Microcomputers are nearly always 
used as stand-alones and currently few 
of them have modems or communica- 
tions software or are in a local area net- 
work. Only the Library microlab have 
Appletalk (for Macintoshes) and 
EasyLAN (for Olivettis, IBM-compat- 
ibles) for linking to printers. 

• Staff and students can dial in from their 
offices or homes Charlie using STD and 
Austpac but permission must be previ- 
ously granted and payment guaran- 
teed. The Austpac PAD has eight lines, 
one for dialling out, the rest mainly for 
dialling in by external students on the 
Graduate Diploma of Computing 
course. 

Staff members and students must register 
on Charlie first before being give a disk or 
directory quota and permission to use the 
centrally installed programs and access to 
certain database, mail, news and printing 
facilities. Once that is done, I can do any of 
the following things by using ihe terminal 
in my office or the microcomputer in my 
office or at home with a modem, a commu- 
nications program and a telephone. 

1 Exchange mail with my colleagues 
and students. 

2 Exchange mail with people in Austra- 
lian institutions (free of charge) 
with people in overseas computer 
networks (at reasonable rate) via 
ACSNET, of which Deakin is a mem- 
ber. 



3 Read and contribute to Deakin news. 

4 Read and contribute to Australian 
news (free of charge) and overseas 
ones (at reasonable rate) via ACSNET. 

5 Access the library catalogue and 
search for books, then phone to ar- 
range for a loan, or send electronic 
mail to a librarian to ask for books to 
be posted to me to save time and a trip 
to the Library. 

6 Send a request to a reference librarian 
to ask him/her to doa database search 
for me and forward the results or 
abstracts of relevant titles to my ad- 
dress on Charlie, which I then process 
and refile into a personal database. 

7 Run statistical programs or CAL pro- 
grams without having to buy them 
pirate them at the risk of breaking 
copyright laws. 

8 Have a word-processed file printed 
on one of the expensive laser printers 
attached to the big machines. 

9 Build a bibliographical database with 
search software and invite some col- 
leagues or students to use it or to add 
to it. 

10 Use the Austpac line to dial out to 
external systems on whicn I am a 
permitted user (e.g. Keylink, iIRlC, 
etc.) 

1 1 Ask my students what they think of a 
course through personalised mail or a 
questionnaire. 

12 Conduct computer conferences to 
simulate tutorials, either in real time 
or in a store-and-forward messaging 
mode. 

13 Get students to produce an on-line 
journal to exchange their writingsand 
thoughts on their course. 
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All there things have not yet been per- 
ceived in Deakin as a kind of package serv- 
ices which we can offer to our external 
students for every course or program, but 
one could see the potentials for home ac- 
cess by a remote student if arrangement can 
benude to allow him or her to dial in using 
a modem linked to a microcomputer. Now 
if one compares these services with the 
kind which has been suggested should or 
could be mounted on a videotex AESNET, 
one could immediately see the advantages 
of having a home-grown and home-based 
network which iscapable of being custom- 
ised to suit the personal needs of the indi- 
vidual student who does not want to travel 
to a local study centre (usually after work, 
at night or during weekends) which can be 
6 or 60 kilometres away. Direct and almost 
instantaneous communications can take 
place between an institute , a teacher and 
a student without the constraints of time, 
place and distance. 

The Deakin scenario reflects the potential 
offerings of a well-endowed institution, 
which may even be able to bear the tele- 
communications costs of the students. For 
institutions which prefer a low-cost front- 
end setup, more modest designs may be 
used. For example, Murdoch University 
has a small bulletin-board type network 
built on an IBM-compatible microcom- 
puter (Atkinson, 1986, 1987). Brisbane Col- 
lege of Advanced Education, on the other 
hand, favours a different approach alto- 
gether by registering their students and 
staff on a network built on Keylink. North 
American and European distance-teaching 
institutions have gene a slightly different 
route again by purchasing off-the-shelf 
computer conferencing systems because 
they are considered to be easier to handle 
by staff and students who may not be too 
computer-sophisticated. (Kaye 1985, 1987; 
Harasiml986) 



The role of an external studies 
netwoik 

These big nd small networks all share the 
following c iectivesand features: 

1 Institutionally-based and home-acces- 
sible. 

2 A more direct communication channel 
between the student and the teacher 
which is not constrained by time, dis- 
tance and place. 

3 Promoting peer group interation to 
remove the feeling of isolation. 

4 Making available resources and oppor- 
tunities which would have been beyond 
the reach of the home-learner. 

It is a little early to know it mey will help 
remove all or most of the disjunctions as 
observed by King and Foster, but they are 
commendable first steps to take to cultivate 
a caring environment. And if members are 
properly led and encouraged, they will 
find imaginative and innovative ways of 
using even the most modestly-resourced 
networks, as it has been found in some 
research projects (Castro 1987). 

rhere is now a small but increasingly ar- 
ticulated view that computer-mediated 
communication systems should be 
adopted in external studies. Bates (1986, 
p42) explains why he sees it as more valu- 
able than the promised wonders of com- 
puter-assisted learning: 

The structuring of the teaching is not con- 
tained in or restricted by the architecture of 
the computer, but developed and negoti- 
ated between learners and teachers. 

To this, it could be added that learning ib 
enriched and multiplied by the sharing of 
wisdom and experience among the stu- 
dents themselves which is far more impor- 
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tant than making the institutional grade 
(Castro 1987). The facilitating of good 
teaching and learning must remain the 
single most important role of any external 
studies network. 

The "messages" ofACSNET 

I feel that it would be discourteous of me, 
delivering a paper with a titlelike AESNET, 
not to pay a tribute to the great network 
mentioned in passing earlier which started 
here in the University of Sydney. 

ACSNET (Australian Computer Science 
Network), cited by Quarterman and 
Hoskins (1986) in their classic paper as a 
"cooperative network", is based on the 
Sydney UNIX Network (SUN) software 
primarily developed by Piers Dick- Lauder 
and Robert Kummerfield of the Basser 
Department of Computing Science. The 
first two machines connected were from 
the Universities of Sydney and New South 
Wales in 1979. ACSNET currently spans 
the continent with approximately 350 hosts 
at universities, institutes of technology, 
CSIRO divisions, Telecom Research labo- 
ratories, and a number of private and de- 
velopmental organisations; and operates 
over fixed lines, leased lines, Ethernet, 
CSIRONET and Austpac. 

The purpose of ACSNET is to support mail 
traffic, file transfer, print jobs, or anything 
that can be transferred in a string of bytes. 
True ACSNET hosts are UNIX machines, 
but there are gateway programs to make it 
also possible to communicate with non 
UNIX systems. There are several UUCP 
(UNIX to UNIX COPY) gateways to North 
America and Europe irom Melbourne. The 
underlying transport protocols are also 
used to support the USENET news trans- 
mitted from America to Australia via the 
Midas X.25 service each evening and paid 
for by the Division of Information Technol- 
ogy at the CSIRO (about $22,000 a year). 



The SUN software (now being upgraded to 
includeX.400capability)isdistributedfora 
nominal charge to academic and research 
institutions. There is no central administra- 
tion, each host is usually managed by a 
small team of experts who also educate or 
help the users if difficulties are encoun- 
tered. The original developers and Robert 
Elz from Melbourne University act as na- 
tional coordinators. There is no govern- 
ment funding; each host pays for its own 
link. 

The addressing format of ACSNET is 
simple to remember and use: user- 
name@host-name.oz. Oz stands for 
ACSNET, which could be regarded as a 
subdomain of AU, the domain name for 
Australia. Messages are passed along on 
ACSNET, from one host to another, possi- 
bly utilising intermediate hosts, in a store- 
and-forward manner. Messages sent 
within Australia is free, overseas messages 
are charged at the rate of between two and 
three cents per 64 bytes. 

The history and the operational mode of 
the ACSNET have some important lessons 
for our discussion of AESNET. It shows 
that a network stands a much better chance 
of success it it starts small, is designed and 
managed by people who are competent 
and committed about a set of clearly de- 
fined and workable objectives, and who 
take the effort to persuade others to join 
them to create a critical mass of users. The 
ACSNET's decentralised model also 
means that there is no complex, overbear- 
ing top management to stifle local initia- 
tives and experimentation, and that the 
aaiveandnewuserwillhave the additional 
advantage of having to learn only the host 
system and be able to correspond with 
others on remote systems without hassle, 
thus reducing the learning curves and 
operating costs but gaining in self-confi- 
dence and efficiency. 
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An automated library and borrowing system 
(ALABS): Implications for CAL 



R . J. Clarke and L Athanasiadis 
Microcomputer Laboratories 
University of Woilongong 



ALABS was designed as an operational control 
mechanism for the loan of floppy-based soft- 
ware, hardware, and audio-visual materials to 
students and staff, and the reservation of micro- 
computer resources in a spatially distributed 
microcomputer centre. This paper describes the 
experience of the Microcomputer Laboratories 
University of Woilongong, which consists of 5 
laboratories of 20 microcomputers each, plus 
another 20 scattered over the campus. ALABS is 
designed to provide software utilization data 
by student (for example CAL courseware), 
laboratory loading statistics, activity rates, as 
well as maintaining an accurate inventory of 
audio-visual, software and hardware re- 
sources. ALABS is suitable for computing facili- 
ties where the diversity of machines and appli- 
cations means that a single network structure is 
neither desirable nor feasible. The impact of 
ALABS on the provision and management of 
large scale CAL facilities is discussed 



Two sets of problems beset individuals and 
organizations attempting to provide CAL 
facilities in the tertiary education- envi- 
ronment. The first set of problems is the 
determination of the type and variety of 
CAL products to be supported (software, 
hardware, audio-visual aids and printed 
materials) by academic and computer sup- 
port staff. Attendant problems include 
accessing the need for new software, deter- 
mining the sources and alternatives avail- 
able for software acquisition, making the 
choice between the internal development 
or purchase of software, installation and 
implementation issues, evaluation of the 
software, the rating of candidate systems 
and the ensuing costs and contractual obli- 
gationsof software acquisition and mainte- 
nance (Borovits 1984, 66-9). 
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The second major set of problems ad- 
dressed in this paper is that of appropriate 
mass distribution (delivery) and manage- 
ment of CAL and other resources after they 
have been acquired or created. Potential 
problems include the structuring of labora- 
tory time, managing loads through labora- 
tories, determining if items on loan are 
overdue or held by staff, finding where a 
particular person isin the centre, managing 
machine bookings, and the allocation of 
resources to these activities. In order to 
solve them in the general case the Micro- 
computer Laboratories restructured its 
methods of material's distribution and 
management, producing a computer as- 
sisted solution called ALABS (Automated 
Library And Borrowing System). 

Facility Description and Physical 
Layout 

The Microcomputer Laboratories provides 
teaching support for all six faculties at the 
University of Woilongong, including 
Commerce, Education, Science, Engineer- 
ing, Humanities and Arts. Subjects sup- 
ported range from machine language pro- 
gramming to creative arts. The facility 
undertakes consultancies (internal and 
external to the University), provides com- 
puting expertise for academic and research 
activities and runs courses for university 
staff and the general community. 

The Microcomputer Laboratories consists 
of 5 teaching laboratories with 20 micro- 
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computers each, an Operations Room, a 
Data Preparation Room, Workshop and a 
Systems Resources Room. Three of the 
laboratories contain Sperry PC Model 25s, 
with 512-640KRAM, dual 5.25" floppy disk 
drives and Colour Graphics Adaptors. 
Two of the Sperry laboratories are config- 
ured using 2 Sperry USERNET 286 LANs 
each with a Sperry PC IT as a file server 
with 30 Mbytes and 44 Mbytes of secon- 
dary storage apiece. The remaining two 
laboratories consist of Apple 2e machines 
with 128 Kbytes RAM, dual 5.25" floppy 
disk drives. One of these laboratories has 
colour displays and the other mono- 
chrome. 

The laboratories are spatially distributed 
(separated by large distances). There are no 
direct lines of sight into any of the laborato- 
ries from the Operations Room. Six staff 
members are employed, only a maximum 
of three are available to periodically check 
the laboratories. 

CAL Resource Management in a Tertiary 
Environment 

There are three vexing and interrelated 
issues in CAL Resource Management 
within a tertiary education environment. 
They are the nature of the CAL resource 
itself, the organizational history and activ- 
ity profile of the facility, and the lack of 
general support tools (network and stand- 
alone) for CAL resource management. 

CAL resources have the following 
attributes 

CAL resources are often multi-media in 
nature. Video disks and tape, kits including 
workbooks, slides, and manuals as well as 
the more conventional software based tu- 
torials, drills and simulation can cortbtitute 
CAL resources. 

CAL resourcesare expensive. In an attempt 
9 duce the long term expense of com- 



mercially available CAL, computing facili- 
ties may opt for internal production. The 
tools required to internally produce CAL 
products (bulk software, high grade docu- 
mentation etc.) are also expensive. In the 
tertiary environment demand for CAL re- 
sources always outstrips the available 
funding. 

Pressures exist to maximize usage of the 
CAL resource yet minimize damage and 
loss. These requirements are in conflict. 

Organizational history and activity 
profile 

Computing facilities in the tertiary envi- 
ronment evolve and can change function 
and scale in unexpected ways. For instance, 
the facility from which the Microcomputer 
Laboratories evolved served as the admin- 
istrative data processing facility for the 
then College of Advanced Education. Fa- 
cilities consisted of a Perkin-Elmer 7/32 
minicomputer and nine Apple 11+ units 
(used for teacher training and to offload 
word processing users from the minicom- 
puter). Upon federation of the College and 
the University, the facility possessed 60 
Apple 11+ and He microcomputers and had 
divested itself of the 7/32 minicomputer. 
An emphasis on computer awareness re- 
placed the administrative role, and the 
internal support function was replaced by 
student training. 

Equipment funding is often sporadic and 
linked to factors outside the facilities' con- 
trol (for example, resource statements asso- 
ciated with new course proposals). For- 
ward planning becomes difficult. 

In the case of microcomputer systems the 
market is so volatile that both hardware 
and software may become obsolete (this is 
a consideration in Information Systems 
area). The systems may not be supported 
by the vendor, or in the worst case, the 
vendor may have ceased trading. 

28 
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The diversity of activities and course re- 
quirements conflict with CAL Resource 
Management priorities. For example, Edu- 
cation users of our facility would like to 
train teachers on as many microcomputer 
systems (those on Government contract) as 
are likely to be encountered in schools. 
Business Systems users would like to keep 
up with the corporate state-of-the-art. 
Users in general want to increase system 
I diversity. Because centre management are 

charged with the support and maintenance 
of existing CAL resources, if not the pro- 
due tion of them, time and effort is reduced 
if systems are as homogeneous as possible. 

Lack of CAL resource management tools 

Networking existing machines and relying 
on the network management system IS 
NOT a solution to CAL resource manage- 
ment. 

Network hardware and softwa. e are very 
expensive, especially with the number of 
workstations required in the tertiary envi- 
ronment. Coupled with the diversity of 
hardware generally found in tertiary com- 
puting facilities, this means that it is un- 
likely that all machines will be networked. 

Network management tools assist with 
network software and global resources 
only. The network tools required in a terti- 
ary environment are different from busi- 
ness priorities. 

Business networking systems are created 
for a small and static number of users. 
Network management tools reflect this. 
For example, USERNET 286 network con- 
tains a function to allow users to be added 
to the system, but only one at a time! 

There are apparently no commercially 
available stand-alone microcomputer 
based systems suitable Tor CAL manage- 
ment tasks. The closest commercial ana- 
logues follow methods proposed in, for 
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instance, the Operations literature (Fried 
1979, 222-260), including Information 
Centres (Perry 1987, 127-147), Service 
Centre Management in general, and the PC 
Resource Centres in particular (Jackson 
1985, 151-154). One package recently re- 
viewed (Syk , 1987), is called Micro Re- 
source Management (Atrium Information 
Group). Again, business resource manage- 
ment priorities are not those of an educa- 
tional CAL provider. This system places 
emphasis on keeping track of machine lo- 
cation, current configuration, and financial 
management of microcomputers within a 
business (Sykes, 1987). 

Whereas the business microcomputer sec- 
tor has arguably been of greatest benefit in 
the production of relatively inexpensive 
and fully functioned software applicable as 
educational tools (Sperry 1985a, 1985b, 
1985c), the means of managing and distrib- 
uting these resources in a tertiary educa- 
tion environment are not available off the 
shelf. This necessitates the creation of in- 
house tools tailored for this purpose. With 
dramatic increases of student numbers and 
transactions (see Table 1), new clients re- 
sulting from the federation of the Institute 
and the University, and the increasing 
timetabling demands of existing depart- 
ments, it was necessary to provid° new 
solutions to cope with the increased 
throughput. This necessitated the restruc- 
turing of laboratory time, borrowing privi- 
leges, and development of a computer 
system (ALABS). 

Restructuring of laboratory time 

The restructuring of the timetable con- 
sisted of dividing time into three catego- 
ries. Free time or 'slack', is time not directly 
utilised for university courses. It is used for 
spreading abnormal student loadings, 
unscheduled classes, external short 
courses, and hardware maintenance. Free 
time is not allocated to a given subject. 
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The regular usage of laboratory time by 
students is divided into two forms. Super- 
vised laboratory time occurs when a tutor 
or lecturer has face-to-face contact with 
students in a class room role. The second 
form of borrowing is by a student for indi- 
vidual study purposes. This is called unsu- 
pervised laboratory time. Time slots are 
assigned to each class generally in a ratio of 
one hour unsupervised to every two hours 
supervised. Unsupervised lab times are 
reserved for a given course. If over the 
period of several weeks these machines 
remain idle, students not in the course are 
allowed to use machines. If this is the situ- 
ation then lab staff allocates the time as 
equally as possible. Special notice is given 
to the distribution of unsupervised eve- 
ning access times (5:30pm - 9:30pm). Care is 
taken to ensure that evening students have 
equal access to the facilities. 

Allocation of the time resource in a spa- 
tially distributed microcomputer centre is 
analogous to other timetabling and opti- 
mum packing problems (finding an opti- 
mum allocation for limited resources). Not 
only can there be a feasible solution, but a 
best arrangement. A collected slack 
method, where Free Time is gathered to- 
gether (Brown 1972, 3),appears to beappli- 
cable to this centre. Although the timetable 
is currently pi spared manually prior to the 
start of each session, the availability of this 
method bodes well for the future automa- 
tion of this task. 

Unique identification of items and us- 
ers; Barcoding 

Similarities between the control measures 
employed in libraries and supermarkets 
led to the adoption of the machine readable 
barcode as the method of uniquely identi- 
fying all items. Barcoding is an ideal 
mechanism for keeping track of numerous 
items required of ALABS. 

The Medium Density Code 39 Barcode 
J ard is used on all types of items in the 



centre (software, hardware, and audio-vis- 
ual). This barcode format has a line of text 
under the code itself. The coding used 
enables the item to be identified directly 
from this text. The three types of barcodes 
are delineated from each other by the value 
of the first character. A Sperry PC and an 
Epson RX-80 printer are used with the 
Barcodes on Demand package (Barcode 
Technologies) to print item barcodes onto 
adhesive address labels. 

Software Barcodes are affixed to the disk- 
ette and covered with contact to prevent 
removal and deterioration. Surprisingly, 
the use of a contact wand does not appear to 
lead to mechanical damage of the disk 
media. A back-up barcode is kept in a soft- 
ware barcodefolder.The foider isuseful for 
quick entering of a class loan. Audio-visual 
items (books, journals, videotapes and 
slides) and hardware items have barcodes 
attached to them in an appropriate format. 

Machine resources are barcoded as well. In 
order for a machine to be used, a student 
must present their student card to the 
Operations Room and receive a lab pass 
along with any software they may need. 
Each laboratory has a set of colour coded 
cards, one per machine. The machines are 
numbered with barcodes. This allows 
clients to be assigned to a particular ma- 
chine for the duration of their visit and 
ensures against multiple bookings of ma- 
chines. A machine is available only when 
its card is held by the lab staff and when 
that laboratory does not have a tutorial 
class currently assigned to it. 

A High Density version of Code 39 Stan- 
dard is used by University Administration 
on the student identification cards. The 
barcode light wand used for ALABS (MR 
300), can read both high and medium den- 
sity barcode formats without a configura- 
tion change. The barcode on the student 
identification card is used to record trans- 
actions for the student, and the 'labpass' 
provides their location. Medium Density 
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Code 39 barcodes are generated as needed 
for staff and tutors who use the centre. 

ALABS System 

ALABS was targeted for an Apple He sys- 
tem, running dBase II under the CP/M 
operating system, as most of the required 
hardware was already available at the 
Laboratories. The initial targeting of an 
Apple lie gave the advantage of a lower 
entry co^t (see Diagram 1 for ALABS hard- 
ware). Mindful of an eventual target to 
another machine, the barcode wand pur- 
chased was a stand-alone unit. 

ALABS was designed as a system to control 
and monitor the borrowing of lendable 
items (software, audio-visual items, and 
hardware) for the Microcomputer Labora- 
tories in the absence of both a single net- 
work structure and network usage control 
facilities. ALABS currently consists of 178 
modules totalling approximately 582 
Kbytesof dBase II, with some Z-80 and 6502 
machine code routines. The system utilizes 
38 permanent databases and several tem- 
porary databases. 

Two main modes are provided in ALABS. 
The first mode is an operational mode; the 
second is a supervisor mode. Super-visor 
mode groups together all powerful or ses- 
sional management functions. These in- 
clude erasing the student and tutor data- 
bases (occurs at the end of a session), delet- 
ing staff members, deletion of the student 
sessional borrowing file, viewing deleted 
library records or archived repair records, 
checking and re-indexing databases, batch 
printing of student sessional borrowings, 
printing staff and tutor databases, initialis- 
ing and altering laboratory bookings or 
adding/deleting machine bookings. 

In the operational mode, loans and returns 
may be made (see Usage Scenarios section 
for more detailed descriptions). Interactive 
functions include determining items cur- 



rently on loan by students, staff, tutors and 
long term staff loans. Included is a count of 
the active student loans. Students and tu- 
tors may have extra items appended to 
current loans. 

The system regularly and automatically 
determines if any items on loan are late. 
Overdue student and staff loans may be 
checked. Offending students who do not 
return items within the required period are 
automatically placed on an offence data- 
base. Depending on circumstances their 
account with the centre may be frozen for a 
given period, so that they cannot use the 
facilities outside of supervised time slots. 

Machines in laboratories may be booked in 
advance according to loading demands 
(due assignments!). Weekly timetables for 
all laboratoriescan be initialised. Functions 
are available to assign a laboratory time slot 
as free, supervised, or unsupervised . Given 
other constraints, individuals may book 
machines no later than a day in advance. 
Terminal booking sheets can be printed. 
Booked machines are released if the stu- 
dent has not arrived within the first 15 
minutes of their time slot. In operation this 
section is reminiscent of a spreadsheet. 

An Auxiliary Commands section allows 
some of the reporting functions of the 
supervisor mode to be performed in the 
operational mode. A hardware mainte- 
nance and repair system and a function to 
change a computer's status (operation or 
under repair) is provided. Also provided is 
a Batch Command Processor which allows 
long reports to be printed overnight. 

Complete library functions are provided 
for item databases. These can be quickly 
edited to reflect changes in stock. Software 
records consist of a barcode, name, version, 
publisher, commissioning date, license 
number, machine usage and disk media 
variety. Audio-visual records are defined 
according to type of item. Journal articles 
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and books are recorded with author, date 
etc. in the manner of a library. If the item is 
a videotape, then the record consists of the 
title, presenter, duration, and category. If 
theitem is a set of slides, then the number of 
slides are also recorded. Hardware records 
include barcode, item, model, supplier, 
serial number, machine number, commis- 
sioning date, location, cumulative down- 
time, and the last date down. 

Extensive database back-up facilities are 
provided. These include all Library data- 
bases (Software, Hardware, Audio-Vis- 
ual), Deleted Library database, Staff, Stu- 
dents, Tutors, Loans (Staff Loans, Staff 
Permanent Loans, Overdue Student 
Loans), Sessional Student Borrowings, 
Offence, Daily Machine Software Usage, 
Hourly Loans Counts, Hourly Borrowing 
Rate, Borrowing Duration, Down Time, 
Down Equipment, Repaired Equipment, 
Faculty Usage, and New Students data- 
bases. 

The system may be temporarily closed 
down for forms printing or maintenance. A 
complete close-down is issued at the end of 
daily transactions. After back-up of trans- 
actions onto floppy disk, ALABS can be left 
unattended. At this time daily reports and 
housekeeping functions are performed. 
Functions performed include the printing 
of a transaction file, updating sessional 
borrowing file, appending New Students 
to the student database, the calculation of 
hourly loan rates, faculty usage figures, the 
printing of machine usage figures, and 
processing overdue student and staff 
loans. Also, expired offences are cancelled, 
and a report on which files to back-up 
before starting operations the next day is 
produced. The machine will power itself 
down after close-down procedures have 
been performed. 

Most of the data entry for ALABS consists 
of single keystroke menu navigation fol- 
lowed by three or more barcode reads 



(student card, labpass' and at least one 
item). A keyboard entry mode is also pro- 
vided in the case of any adventitious failure 
of the barcode wand. 

Usage Scenarios 

Unsupervised Student Borrouring 

When borrowing an item the student 
number from the student card is read using 
the barcode wand. If the student is not on 
the sessional database, the operator is 
alerted and the student manually provides 
full details on a Sessional Student Borrow- 
ing Form. The details are entered into 
ALABS by the operator, and loans can be 
made. The student card is retained by 
centre staff member for the duration of the 
loan. A machine/lab pass is read and given 
to the student. Requested items are found 
and each barcode is read. Machine alloca- 
tion and loan duration is currently two 
consecutive hours. Students may re-bor- 
row at the end of each two hourly interval 
if demand for the item is low. Borrowing of 
audio-visual media (example training 
packages) and manuals, is also subject to 
similar procedures. Hardware is currently 
only lent to academic and general staff 
members. 

Returns are performed in a similar fashion, 
with the 'labpass' and items retained by the 
centre and the identification card returned 
to the student. 

Staff and Tutor Borrowings 

New tutors and staff members are intro- 
duced to the centre by a representative 
from their department. At this time, all 
relevant details are entered concerning the 
person. This information is manually re- 
corded on a Staff Borrowing Form, then 
entered into the system. Each tutor is iden- 
tified by a unique two digit barcode which 
is stored in a folder for quick access. In 
addition, staff numbers, unique three digit 
numbers, are stored in the same folder. 
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Staff members may also be tutors, that is an 
individual may have two borrowing num- 
bers. A staff member will borrow items 
useful to their research work, whereas a 
tutor will borrow teaching sets of software. 
Delineating loans in this way enables dif- 
ferent loan durations to be exercised. 
AL ABS pri n ts ou t a form le t ter overnight to 
staff members with overdue loans. 

Class Loans 

For a class, tutors will generally borrow one 
or more class sets of disks. Once the trans- 
actions are recorded using ALABS, it is 
then the tutor or lecturers' responsibility to 
log the student using a particular software 
item against the item number on a sheet 
provided (Class Loan/Borrowing Sheet). 
At the end of the class, the items are 
checked against the name of the student so 
that an audit trail is maintained. 

Implications and Future Extensions 

Organisational arrangement is as impor- 
tant as a technical solution to the problem 
of CAL and general course based resource 
distribution and management. The combi- 
nation of an appropriate organisational 
structure and a computer system ALABS 
has proved to be a reliable solution. 

Resource distribution and management in 
theCALfield, need be nodifferent to that of 
providing resources for more general 
computing courses. An appropriate design 
can satisfy both. 

ALABS has proved to be a successful 
mechanism for the distribution and man- 
agement of CAL and related items in a 
tertiary education computing service 
cen tre. Successful software for the manage- 
ment and distribution of CAL and related 
items imbeds the operating procedures of 
the organisation within the system and 
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provides the minimum cost consistent with 
the ability to meet the evolving needs of 
tertiary educational requirements. 

ALABS is currently being ported to a PC 
environment where it will run as Clipper 
compiled dBase III+ application. Sections 
of the system have been redesigned to take 
advantage of the more sophisticated lan- 
guage. The change in language has already 
resulted in simpler code and fewer data- 
bases. Increased speed will result f a the 
use of a faster host machine, ^yst > per- 
formance trials have indicated a conserva- 
tive 2.2 times speed increase when this port 
is completed. 

Some operational performance bottlenecks 
exist. Different types of users (tutor class 
loan/ returns, terminal bookings and nor- 
mal student loans), can lead to servicing 
delays during peak activity. To correct this, 
the new version of ALABS will be 
multi-user, and operate from PCs con- 
nected to the LAN. During peak loads two 
operators might work on the system servic- 
ing different user types. 



Table 1: Sessional Unsupervised Transac- 
tions (1985-1987) 



Year 


Session 


Transactions Comments 


1985 


1 


1,591 


Manually 








recorded 




2 


2,277 


Manually 








recorded 


1986 


1 


3,164 


ALABS 




2 


5,389 


ALABS 


1987 


1 


10,318 


ALABS 
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Bringing the distance student on campus 
the Riverina way 

Brian Cornish, Mark Johnston and Michael Whitelaw 
School of Information Studies 
Riverina-Murray Institute of Higher Education 



The study of computing at tertiary institutions 
normally involves a substantial component of 
practical work. This usually takes the form of 
programming or use of applications software. 
Traditional approaches to the teaching of com- 
puting in the external mode generally use the 
residential school as the means by which the 
practical component ; i satisfied. 

This paper describes the use of dial-up facilities 
as the primary mode of communication and 
teaching in a post graduate course for students 
interested in computer applications. The devel- 
opment of software to enhance various aspects 
of communication is documented. Results of 
surveys of student attitudes are provided, to- 
gether with statistics of usage and achievement. 



The School of Information Studies at River- 
ina-Murray Institute of Higher Education 
commenced the design and development 
of a new Graduate Diploma in Computer 
Applications in 1983. 

As described in the course proposal docu- 
mentation (Graduate Diploma in Com- 
puter Applications Stage n/III Proposal, 
Riverina-Murray Institute of Higher Edu- 
cation, May 1985): 

This course is aimed at providing the 
information management expertise 
that is necessary for significant com- 
puting activity in various professional 
groups. 

The general minimum requirement for 
admission to the Course will be an Under 
Graduate Degree from a college of ad- 
vanced education, university or equivalent 
institution. However, admission may be 



considered for an applicant who has dem- 
onstrated professional development by 
one or both of the following: 

• Membership of a professional associa- 
tion which requires academic experi- 
ence based qualifications; 

• Professional seniority or status. 

Students will not be expected to have any 
academic knowledge of computing at time 
of entry. Students who have completed 
any degree in computing, or an academic 
major in computing as part of a degree, will 
not be eligible to enrol in this course. 

This course is offered in the external mode; 
during the development of the course, the 
School considered various ways of provid- 
ing computing power for students study- 
ing the course without requiring them to 
attend a large number of residential 
schools. 

The following options were contemplated: 

• All the students being required to buy 
one (1) of a small number of particular 
brands of microcomputer, for use re- 
motely; or 

• All the students being required to buy 
one (1) of a small number of particular 
brands of computer and to use direct 
dial to connect to the Institute's com- 
puter; or 

• The students being allowed to buy any 
suitable terminal and use the AUST- 
PAC system. 
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The decision was made to use the AUST- 
PAC facility, and as stated in the course 
z [ documentation /'the high level of machine 
J excess would normally prove a problem to 

* a course being offered in the external mode, 
{ butas the Institute has an AUSTPACmode, 
I as well as telephone dial-in facilities, stu- 
" dents from anywhere in Australia will have 

access to the Institute equipment, at a cost 
| of something less than $8.00 per hour. 
| Students are required to provide them- 
I; selves with terminal equipment which will 
t connect to the AUSTPAC facility." 

r+ - 
k 

t This procedure has proved to be highly 
\ % satisfactory. Students have used a full 

* range of microcomputers, and some stu- 
t dents have used main-frames to connect to 

the Institute's VAX system. The Institute 
f leaves the responsibility of selecting suit- 
able equipment for connection to the 
AUSTPAC system to the student. 

The students attend two (2) residential 
I schools during the period of this course, 
one at the beginning of the course, the other 
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at the end. At the residential school at the 
beginning of the course, the students are 
introduced, amongst other things, to the 
AUSTPAC system and taught how to log 
on to the Institute's VAX system from 
AUSTPAC. 

The first intake into this course was in the 
Spring Semester 1985, and some of these 
students recently graduated. 

Communication with Distant 
Students. 

AUSTPAC usage 

The Institute rents AUSTPAC from Tele 
com and for the first eighteen months of the 
course, bore all costs. These averaged 
approximately $825 per month, being 
comprised of monthly rental, a fixed charge 
per call and a variable charge based on 
volume of traffic and connect time. It then 
became necessary for thelnstitute to charge 
students for use of AUSTPAC over a basic 
allowance for each subject. 
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As Telecom was unable to charge individ- 
ual users, it was le't to the Insti tu te to devise 
appropriate accounting procedures. VMS 
identifies users by a terminal number and 
type, with AUSTPAC users being denoted 
by an NVA prefix. It thus proved to be a 
simple matter to identify NVA users at 
login time arid call a program which checks 
a file of valid users. The file contains the 
balance of connect time available for use 
which h displayed on the user's screen at 
login time. This is automatically updated 
dailyby the VMS accounting facility. Users 
can thus monitor their usage. Postgradu- 
ate students receive an automatic alloca- 
tion of five hours of connect time per sub- 
ject. Further time is paid in advance 
through the School office where a program 
updates the balance in the valid user file. 
Any user not contained in the valid user nle 
or whose balance is exhausted, receives the 
appropriate message and is automatically 
logged out. The overall system is depicted 
in Figure 1. 

Use of electronic mail 

The course is structured so that students 
attend a residential school at the com- 
mencement and at the end of their study. 
At other times the main vehicle for commu- 
nication is electronic mail via the Institute's 
VAX computer. Communication, how- 
ever, encompasses many different aspects 
of study. Common categories are listed in 
Table 1 below. Proportions of one 



lecturer's mai 1 concerning this course are 
also included. 

Initially, electronic mail was used to handle 
all of the above transactions. The mail 
facility in VMS version 3 had no sub-direc- 
tory or folder capability, with the result that 
mail files were large and difficult to organ* 
ize. One can easily appreciate that witl 
multiple assignments and 30-50 students, 
good organization and frequent access to a 
computer terminal is essential. It also 
quickly became obvious that users should 
keep copies of all important mail sent in so 
that problems or disputes be quick] y re- 
solved. VMS mail has provision for the 
username to which the message is being 
directed and a subject heading. When re- 
ceiving .nail, the usemame originating the 
message and the subject appear when a 
directory of mail is obtained. Ordinary 
users of mail tend to be rather vague and 
casual in the details entered in the subject 
headir^;. Typically, they deal with small 
numbers of messages and may delete them 
quickly. When lecturingin a course such as 
this, a much more efficient use of mail is 
required since one has to glean information 
as quickly as possible without laboriously 
reading every message. When sending a 
message a copy is kept for oneself. Since 
mail shows the originating username, one 
soon finds numerous messages with one's 
own username and no way of distinguish- 
ing them short of reading each one. It 
quickly became apparent that the subject 



Table 1 Common categories of communication 



Direction of 


Nature % of total mail 


communication 


over 12 months 


student -> lecturer 


query re coursework 


32 


lecturer -> student 


response to query 


29 


student -> lecturer 


problem report 


5 


lecturer > student 


assignment handout 


2 


student -> lecturer 


assignment handin 


1 


lecturer -> lecturer 


problem report/response 


3 


lecturer -> student 


assignment feedback 


28 


lecturer -> student 


acknowledgement of receipt 


N,A. 
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jr heading should be used to record the 

f student's username and nature of transao 

l tion so that directories of mail could be 
quickly scanned for information. e.g. 

| Subject DPG1111 Tute7marks 

i 

I . VMS version 4 offered a considerably 
£ improved mail facility with provision for 
| separate foldersor sub-directories to which 

mail could be directed. Three folders are 
p" normally in operation : NEWMAIL, MAIL 
| and WASTEBASKET. New unread mail 
| : appears in the NEWMAIL folder; once 
f read, mail is transferred to the MAIL folder 
i and once deleted, is transferred to the 
| WASTEBASKET from which it can be re- 
' covered before the end of that mail session. 

Other folders can be created to contain the 
*- various categories as listed in Table 1. It 
f then becomes a simple matter to scan the 

directory of a small folder in order to ascer- 
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tain if a particular student has completed 
certain work or responded to a request. 

The use of mail can be a time consuming 
activity, especially on a multi-user com- 
puter with numerous other demands. A 
particularly noticeable issue was that of the 
handling of student assignments. Initially, 
these were sent to the lecturer concerned or 
to a class account via mail. The lecturer 
would then extract each message/assign- 
ment, taking care to place it in an appropri- 
ate sub-directory using the student's user- 
name for later marking. One method 
which was tried initially was to have stu- 
dents send their assignments to a 'clearing 
house' account, from where a notification 
mailing was done. The assignments were 
then mailed to other marking accounts. 
This resulted in considerable douole han- 
dling and inefficient use of time. An on-line 



Figure 2: Common communication transactions 
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menu-driven system of automatic 
handin.was therefore developed, so as to 
allow the student to select the subject and 
the exercise for which he/she wished to 
submit a file. The file was then copied 
directly to the appropriate sub-directory of 
a 'secref account for later marking. At the 
same time, a notification of receipt mail 
message was automatically sent to the stu- 
dent; thus considerable unnecessary han- 
dling of mail was eliminated. As can be 
seen from Table 1, most mail is now con- 
fined to student queries and responses. 

Some exercises, which are multiple choice 
and/or short answer in nature, can be auto- 
matically marked in the sub-directory to 
which they are sent. Result files can then be 
automatically mailed to students and re- 
sult file directories can be automatically 
scanned to feed results into a spreadsheet 
mark book. The automatic handin pro- 
gram has also been adapted to offer an 
interactive on-line test in some subjects. 

A flow diagram representing these transac- 
tions is shown in Figure 2. 

Student usage 

As connect time is limited and since work- 
ing on-line at 300 baud (the most common 
rate) is relatively slow, it is important to use 
time efficiently. Text or data entry is best 
done off-line on the student's own micro- 
computer and connect time to the VAX 
used for uploading, handin or testing. 



Some subjects, such as the introductory 
programming subject, enable students to 
do almost all their work on their own 
machine. Others, which require special 
software, make more demands on connect 
time to the VAX. Some statistics of student 
usage are presented in Table 2. Inesewere 
averaged over the months February to June 
1987. 

From these data it may be reasonably con- 
cluded that students are making efficient 
use of connect time. This may also account 
for the fact that up to 50 postgraduate stu- 
dents have been able to coexist using only 
five AUSTPAClinesandthree local dial-up 
lines to the VAX. It can also be seen that 
most usage is concentrated in the off peak 6 
pm - 8 am period. 

Student Profile 

Some of the characteristics of the first co- 
hort of students were measured. Perhaps 
the most important characteristic is that of 
success. Two measures of success are used. 
The first is quantitative and is the propor- 
tion of the course completed in minimum 
time. The course consists of 6 equally 
weighted subjects and one double subject. 
This gives a measure with a scale 0 to 8. 

The other measure of success is qualitative; 
it is the current status of the student. The 
student may be a graduand , i.e., have 
completed the course. The student may be 
continuing. Such a student has taken 



Average connect time/session/user 12 minutes 

Average connect time/ month/ user 3 hours 

Maximum connect time/month/user 10 hours 30 minutes 

Average number of connections/month/user 15 

Maximum number of connections/month/ user 45 

Average total connect time/month 80 hours 

Average connect time/month (off-peak cost) 54 hours 

Average connect time/month (peak cost) 26 hours 



Table 2 Statistics of student usage 
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Excluded 


Continuing Graduand 


Total 




8 




11 


11 


Proportion 


n 

1 




l 


1 




6 








of 


5 










4 


i 






Course 


3 










1 


1 




i 


Completed 


1 


6 




6 




0 


5 




5 


Total 


13 


3 11 


27 



Table 3 - Successfulness 



longer than the minimum time to complete 
the course but still, at the time of writing, 
may be ultimately successful. Finally a 
student may be excluded. 

Exclusion is not to be interpreted pejora- 
tively. The Institute excludes any students 
who do not maintain an adequate rate of 
progress. The student may indeed be at- 
tempting subjects and failing them through 
inadequacy; however, many of the stu- 
dents who decide to withdraw fail to notify 
the Institute of their intentions. It is only the 
zero rate of progress that enables the Insti- 
tute to recognize the withdrawal and re- 
move the student from the course. Unfor- 
tunately, the number of students who with- 
draw and are polite enough to inform the 
Institute are sufficiently small that it has 
not been felt necessary to create a special 
category. 

Those first cohort students who completed 
the course in minimum time are now grad- 
uands. Table 3 shows the distribution of 
the students between the two measures of 
success. 

Current graduation rate is 41% and could 
rise to 52%. Most students who do not 
succeed, fail in one or both of the first tMjo 

O 



subjects studied. Indeed 85% of the stu- 
dents now excluded had been excluded by 
the end of the first programming subject. 
This makes early performance a good pre- 
dictor of ultimate success. 

Some other piedictors that could be used 
are verbal ability, spatial ability and atti- 
tude. These predictors have the advantage 
of requiring only a short interview to be 
assessed, so they are a tempting screen for 
administrators of a popular course who 
have to decide who is to be admitted to a 
course. These predictors were measured at 
the start of the course and compared 
against final success. As will be shown 
below, none were found to be as satisfac- 
tory a measure as success in the first sub- 
jects. 

The test used for verbal and spatial ability 
was Heim's AH5 Test (Heim 1968) of group 
intelligence. This test is a group intelli- 
gence test designed to assess people al- 
ready known to be towards the top end of 
other intelligence scales. Results have been 
related to University and Teachers' College 
students. The test is a relative test, in- 
tended to disperse the group across the 
scale rather than measure ability in abso- 
lute terms. 
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Table 4 - Successfulness versus Verbal Ability (one student did not do the test) 



For ease of cc mprehension, scores are con- 
verted to graaes such that the first 10% are 
given an A, the next 20% are given a B, the 
middle 40% a C, the following 20% a D and 
the lowest 10% an E. Analysis of the test 
was carried out by Reid-Smith(1985). 

The first part measures verbal ability. The 
students scored between 10 and 24. This 
spreads the students between E and B at 
University level; or E and A at Teachers' 
College level. Table4 provides the distribu- 
tion of verbal ability versus achievement 
level. A student is recorded as an "e" if he 
is excluded, a "c" if continuing and a "g" if 
a graduand. 



It is clear from Table 4 that success does not 
depend on verbal ability. It must be re- 
membered that the population is already 
pre-selected so such a statement may not be 
true of the full range of verbal ability. 

The second component of the AH5 test 
used was that which measured spatial abil- 
ity. Again, it is a test intended to show 
differences in a narrow range of abilities 
rather than measuring absolute abilities. 
The results are in Table 5. 

There is no apparent relationship between 
spatial skills and success shown in Table 5. 
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J In fact, there may be some relationship 

| between very poor spatial ability and fail- 

i : ure, as the student who performed badly 

* ^ on the spatial test but graduated was sick 

\ > on the day of the test. Her subjective im- 

i pression was that her performance was 

j significantly affected. 

Another characteristic measured was that 
of attitude on entry. The instrument used to 
measure attitude was a subset of the ques- 
tionnaire used by Wilson and Braun to 
distinguish between groups of students 
(Wilson and Braun,1985). The subset were 
those questions in the original question- 
naire found to sho w significant differences 
in attitude towards computers. On analy- 
sis, Reid-Smith showed this subset to be 
88% perfect inbeinguni-dimensional with 
a neutral point at 33 (Reid-Smith, op cit). 

The attitude of students on entry is meas- 
ured against success in Table 6. While it is 
clear that a neutral to positive attitude 
: helps, it is still possible for a student to 
graduate in minimum time even if a rather 
antagonistic attitude towards computers is 
held on entry to the course. 

Conclusions 

AUSTP AC has proved to be a very satisfac- 
tory method for allowing Distant Students 



to communicate with their lecturers and to 
use the Institute's VAX computers. 

From the results of the four measurements 
used with the first cohort of students in the 
Graduate Diploma, it would appear that 
the probability of success is enhanced by a 
good attitude towards computers, is not 
limited by spatial abilities, is even less 
affected by verbal abilities, and is best 
predicted by the results in the initial sub- 
jects. 
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Computerised formative assessment 
powerful new tool 
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The Royal Australian College of General Practi- 
tioners has some 2000 young doctors undertak- 
ing post graduate training in the family medi- 
cine programme. They are scattered all over 
Australia in supervised practical experience 
and supplying them with high quality educa- 
tional materials is a major problem. An interac- 
tive computerised, formative assessment sys- 
tem has been established on Viatel called 
CHECKUP (Computerised Home Evaluation of 
Clinical Knowledge, Understanding and Prob- 
lem solving) .It consists of a bank of over 8,000 
TF questions and a series of diagnostic and 
management problem solving exercises. The 
CHFCKUP software runs on a VAX and is avail- 
able for CAEs, universities and continuing 
education programmes for almost any subject 



Most teachers are concerned about making 
their teaching more effective and efficient. 
The best way to do this is for your students' 
learning to be more effective and efficient 
and the best way to do that is to ensure high 
levels of motivation to learn and to provide 
feedback for them on their learning. 

There are many ways that feedback can be 
provided to students. One such way is to 
give them access to assessment processes 
during their learning that reveal where 
they are going right and where they are 
going wrong, and why. This type of assess- 
ment is called formative assessment and 
aims to improve performance by providing 
feedback. The more common -summative 
- assessment usually takes place at the end 
of learning, is designed to grade students, 
and generally provides little feedback on 
their specific strengths and weaknesses. 



It is now possible to provide computerised 
formative assessment to students, in the 
area of knowledge and problem solving, 
using software written for this purpose 
called FACTS (Formative Assessment 
Computerised Testing Service). FACTS is 
written in Fortran and was developed by 
the RACGP's Family Medicine Programme 
for their 2,000 or so young doctors in an 
apprenticeship— based, four year post- 
intern programme in hospitals and prac- 
tices throughout Australia. 

The RACGP/Family Medicine Pro- 
gramme call their medical version of 
FACTS CHECKUP (Computerised Home 
Evaluation of Clinical Knowledge, Under- 
standing and Problem solving). Delivery 
of CHECKUP is through Telecom's Viatel 
system which provides ready access to the 
computer from anywhere in Australia via 
the public telephone network at a reason- 
able price (9 cents a minute in business 
hours and 6 cents a minute outside). 

The Family Medicine Programme cur- 
rency has 50 Viatel terminals circulating 
among its trainees, so that each trainee 
should have access to CHECKUP at least 
once a year. Advertising on CHECKUP 
supports most of the operating costs. 

FACTS consists of two main parts: 

• a bank of true/false questions designed 
to assess factual knowledge 

• a bank of diagnostic problems designed 
to assess problem solving ability. 
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Question bank 

The question bank is designed to be ac- 
cessed in two different ways. A menu 
structure allows the user to focuson an area 
of interest or the computer will select ques- 
tions at random from a "poor of questions. 
For example, the CHECKUP system is ar- 
ranged to allow access via: 

• Diseases and Conditions, 

• Random, 

• Signs, Symptoms and Abnormal Tests, 

• Special Subjects, and 

• Systems, 

where Random and Systems are pools. 
Questions are entered in several parts of the 
bank; for example, all questions go into the 
random pool, while cardiac questions will 
also be in the Circulatory System pool as 
well as in part of Diseases and Conditions 
and perhaps in Signs and Symptoms or 
Special Subjects. A summary of the 
CHECKUP menus is attached. 

The True/False questions are arranged in 
sets of four parallel questions a,b,c,d. If the 
user answers la correctly, 2a is presented, 
but if it is answered incorrectly, lb is pre- 
sented followed by 1c and Id. This is to test 
whether a small slip has been made or a 
significant lack of knowledge has been 
identified. If these additional questions are 
all answered correctly, 2a is then presented 
and no "error" is recorded. If, however, 
one or more of them is answered incor- 
rectly, the computer records this topic as 
one needing attention. Likewise if three or 
more of the questions in one topic are an- 
swered incorrectly, but all the b, c, and d 
questions following are answered cor- 
rectly, this is also considered an area re- 
quiring attention. Arranging the questions 
in sets of 4 also has the advantage of being 
able to present a fresh set of questions each 
time the user re — enters a topic (up to 4 
times). 

At the end of a session, a list of topics 
undertaken is presented, along with a list of 



those topics requiring further attention. 
This is provided (if required) as a printout 
to both the FMP doctor and his/her train- 
ing adviser for discussion at their next 
meeting. No score is calculated, as the 
emphasis is on remediation rather than 
ranking. 

The system also allows users to send mes- 
sages to FMP at the end of a session, e.g., 
complaining about the accuracy of a ques- 
tion or the ambiguity or relevance of a 
question. This is an important feedback 
mechanism for maintaining the bank in a 
healthy state. 

Statistics are collected on the use of the 
system which will allow comparisons to be 
made between performance of different 
groups of doctors and it also identifies 
questions with high failure rates. These 
may indicate poor questions or significant 
areas of deficiency in doctors' knowledge 
which would then need to be addressed 
through educational channels. 

Problem bank 

The problem bank is designed to give feed- 
back on the learner's problem solving 
strategies. It does this by presenting the 
initial data on the problem and then allow- 
ing the learner to ask questions in a number 
of categories. The format is open and the 
learner can return to any category as often 
as he likes and ask as man^ questions as 
needed. When the solution has been en- 
tered, feedback is provided. 

The CHECKUP problems provide an open- 
ing description (the patient's presenting 
symptoms) followed by a pathway frame 
which offers alternative types of action 
which could be taken (history, examina- 
tion, investigations, emergency treatment, 
etc.). This pathway frame can be returned 
to at any time to select a different type of 
action. 

Once a particular type of action is selected, 
the user specifies what he wants by typing 
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in the first three letters of the specific action 
or information required (e.g. ,DIE for Diet if 
you want to know about the patient's diet 
or SMO for Smoking History or CAT for 
CAT scan). The computer then provides a 
menu of all items in that section starting 
with three letters, or, if there is only one 
item, it supplies the response. 

The user works his way through the prob- 
lem until he thinks he has solved it, when 
he enters his solution. The computer then 
gives the expected solution plus a descrip- 
tion of how the problem could have been 
solved. This is followed by feedback to the 
user in the form of a list of items chosen 
which would have been useful in solving 
the problem, marked + ve, but also includes 
those which would have been counterpro- 
ductive (in CHECKUP this includes unnec- 
essarily invasive, harmful or costly investi- 
gations) marked — ve. These enable the 
user to compare his list with a similar one 
for each of two competent professionals 
who did the same problem. It is illuminat- 
ing to see which questions they asked and 
to realise that even experts make mistakes 
occasionally! 

The problems can be scored; in fact this 
system wasused by the RACGP candidates 
sitting for the Patient Management Prob- 
lem component of their Fellowship exami- 
nation this year in all the capital cities in 
Australia. 

The exam problem choices are printed out 
in chronological order. This feature can be 
used to follow the thinking of the person 
solving the problem. This process is helped 
if the users are asked to write down their 
hypotheses and indicate which hypothesis 
they are testing and whether the response 
confirms or refutes the hypothesis. 

Facts in tertiary education 

Universities and CAEs could provide a 
valuable and powerful learning tool to 
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their students by establishing FACTS on 
their computers and encouraging depart- 
ments and schools to enter their own ques- 
tions and problem banks in the system. 
This could lead to a substantial increase in 
the effectiveness and efficiency of their 
teaching programmes, at least in the area of 
knowledge and problem solving. The 
pooling of questions and problems by all 
institutions around Australia which con- 
duct courses in the same area, e.g. , nursing, 
medicine, chemistry or botany, would cre- 
ate a magnificent data base for each course 
to use. 

Other developments 

The RACGP Family Medicine Programme 
is also providing a management problem 
on Viatel; here the diagnosis is given, ques- 
tions are asked about management, and 
feedbackis given on the choices made. This 
is a branching programme originally de- 
signed by Monash University's Depart- 
ment of Community Medicine and based 
on the Modified Essay Question (MEQ) 
format, which does not require interactive 
capability and so is provided on normal 
Viatel frames. 

A Special Interest Group (S.I.G.) has been 
set up on Viatel called General Practitioner 
Network. This is in effect an electronic 
scribble board for GPs on which they can 
put notices about clinical matters, confer- 
ences, interesting articles, useful resources, 
etc. Notices drop off automatically after a 
nominated time (14 days in this case) or can 
be removed by their owner. This S.I.G. will 
help to break down the professional isola- 
tion of many GPs. 

A read only bulletin— board has also been 
established with dates and times of meet- 
ings, conferences, etc, and important infor- 
mation. 

The future 

An update service will be added to 
CHECKUP which will allow the doctor to 
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read the latest developments on, say, AIDS. 
This should prove a very valuable service, 
but requires substantial work to establish 
initially and to maintain at a high standard. 

A community Health Information Service 
is proposed which would be open to the 
general public and enable them to access 
health information and possibly pay for the 
time on the system through coin — in — 
the — slot terminals in public places such as 
pharmacies, hospitals, libraries and 
schools. If successful, this would allow 
most Australians to access high quality 
health information at a reasonable cost. 
Access will probably be /ia menus of dis- 
easesand conditions or patterns which list 
information under headings such as: 

• wha* causes it? 

• what are the symptoms? 

• how can I prevent it? 

• what treatments are available? 

• can it be cured? 

It is expected that other professional 
groups will establish data bases on Viatel 
similar to CHECKUP to provide continu- 
ing education for their members in the 
field. 

For further information, 

• about the education aspects, contact: 
CHECKUP COORDINATOR 
Family Medicine Programme, 
70Jolimont Street, 
JOI.IMONT,3002. 

• about the software, contact: 
Merlin Communications, 
147 Eastern Road, 
SOUTH MELBOURNE, 3205. 



Acknowledgements 

The FMP development team consists of: 
Ms. Jude Blackwood, Computer Services 
Co-ordinator, Dr. Wes Fabb, Director of 
Education, Dr. Peter Fleming, Director of 
Educational Development, Dr. Jack 
Marshall, Director of Educational Research 
and Resource Development. 



147 



Computer enhanced distance learning 
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This paper presents preliminary results and 
suggestions on the use of micro-computer/ 
mainframe linkages in the teaching of under- 
graduate courses. The Endings presented are 
the result of a co-operative effort between 
Mitchell College of Advanced Education and 
IBM Australia. Concrete data is given on the use 
of microcomputers in the study of a computing 
subject and a social science subject for first year 
undergraduates at Mitchell College. Various 
preliminary findings based on computer usage 
data and information from questionnaires dis- 
tributed to the participants is presented and 
appropriate conclusions drawn. 



and applied science. A number of units 
studied in the courses provided by Mitchell 
College require the use of some form of 
computing. This usage is split into two 
areas at Mitchell College; that of units 
'abouf computers and units 'using' com- 
puters. The latter units typically would use 
a computer to run statistical and word 
processing packages and the former units 
are those using the computer to compile 
and execute programs in computing 
courses. 



Mitchell College of Advanced Education is 
a College that has the majority of its stu- 
dents studying in the external mode. The 
external mode of teaching means, in 
Mitchell's case, an extension of the New 
England model as distinct from the corre- 
spondence model. The s*udent is required 
to attend a four or five day residential 
school at the College in the middle of each 
semester as well as optionally attending 
some weekend schools presented at vari- 
ous centres. The student receives a set of 
study materials containing assignments 
and unit information, a study guide and a 
booklet containing selected readings. 
Other material such as cassette recordings 
and videotapes may also be made avail- 
able. 

The students studying in this mode are 
distributed over a wide geographical base. 
The units in various courses studied by 
external students range from business and 
law through to computing, social science 



Much effort is expended at Mitchell Col- 
lege by lecturers and external studies staff 
in preparing the study guides used by the 
students. The staff at Mitchell are con- 
stantly seeking new methods to enhance 
distance learning. One of the major en- 
hancements addressed in this project is to 
increase the lecturer/student, student/ 
student and student/institution interac- 
tion. 

Microcomputer Assisted Distance 
learning 

The main driving force in improving dis- 
tance education has been the development 
of new technology. The application of new 
technology to distance learning has re- 
ceived a great deal of attention and is re- 
ported in the literature (Bates, 1984). 

The use of microcomputers as a delivery 
system for material, linked to computer(s) 
at a central location has been discussed but 
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not as yet implemented (Clark, 1986). At- 
tempts have been made, for example, by 
Capricornia Institute of Advanced Educa- 
tion, to use computers in distance educa- 
tion. This attempt ,however, was to use 
microcomputers at study centres and not in 
individual students' houses (Cook, 1985). 
Some tertiary institutions, Mitchell College 
amongst them, have encouraged students 
who have microcomputers at home to use a 
communication program and modem to 
dial into the institution's mainframe and to 
use the facilities to complete assignments 
and use any other facilities that may be 
available. This method of use has been 
encouraged but not investigated along any 
cohesive development plan. 

A pilot project using a microcomputer/ 
local area network/mainframe linkage 
was initiated at Mitchell College in the lat- 
ter half of 1986, with the co-operation of 
IBM Australia. 

Project Aim 

The aims of this project fell into three main 
categories: technical, student background 
and educational enhancement. Specifi- 
cally the aims were:- 

1. to investigate whether the use of a mi- 
cro- computer at home would enhance 
the students' learning process; 

2. to investigate the technical and organ- 
isational aspects of establishing a reli- 
able communication network between 
Mitchell College and external students 
for use in distance education; and 

3. to investigate the suitability of different 
types of unit presentation and content 
coupled with the students' background 
in using computing facilities. 

One of the main incentives for these objec- 
tives was the lack of published experimen- 
tal information of any microcomputer/ 



mainframe studies in distance education. 
Most information in this area is of an anec- 
dotal nature. It was decided at Mitchell to 
embark on a pilot study to collect and 
publish some information in this area. 

Project Hardware 

The facilities needed to implement the 
project have been provided by a co-opera- 
tive venture between IBM Australia and 
Mitchell College. IBM Australia lent a 
mainframe and associated equipment and 
Mitchell College supplied microcom- 
puting facilities to students participating in 
the project. 

The mainframe equipment used was an 
IBM 4361, a console, 4 colour terminals, a 
line printer, a tape drive and 12 Gbytes of 
disk storage. The "alue of this equipment is 
estimated by IBM xo be of the order of $750 
000. The operating system used for the 
project was MUSIC running u nder the IBM 
VM operating system. IBM also provided 
Pascal, COBOL and FORTRAN compilers 
as well as a graphics package, a communi- 
cations utility called PCWS and a package 
for the implementation of computer aided 
instruction material. 

Mitchell College supplied each of the 30 
students participating in the project with 
an IBM JX personal computer, colour 
monitor, two floppy disk drives and a 
Netcomm 1200A Smartmodem. Each stu- 
dent was supplied with a copy of a 
wordprocessing package, the MS-DOS 
operating systemand utilities and a copy of 
PCWS. PCWS enabled communication 
using IBM 3270 emulation between the 
microcomputers at home and the IBM 4361 
mainframe at Mitchell College. The use of a 
synchronous protocol emulation at home is 
a significant feature of this project. AUST- 
PAC communication was installed to the 
ethernet Local Area Network (LAN) that is 
used at Mitchell College. The students dial 
into AUSTPAC from home and are con- 
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nected to the CoK ^ LAN. Once con- 
nected to the LAN, provision for further 
connection to any of the host systems can be 
established using a simple LAN menu fa- 
cility. The IBM system is one of the host 
systems on the LAN. 

Project Software 

The key piece of software for the project 
was a microcomputer program running 
under the MS-DOSoperating system called 
PCWS. 

The PCWS program allows the student to 
use the IBM JX at home as if using one of the 
colour terminals connected to the main- 
frame at College. The PCWS program also 
allows the student to transfer programs/ 
assignments from/ to the mainframe in a 
very convenient fashion. This is achieved 
due to the integration of PCWS and the 
MUSIC operating system supplied by IBM. 
This operating system was developed at 
Magill University in Canada and was de- 
signed to be simple to use and yet provide 
a powerful working environment. A 
wordprocessing package, PC Write, from 
the public domain was also supplied to 
students allowing them to wovdprocess 
assignments on the IBM JX machines for 
later transfer to Mitchell College. 

Project Organisation and Implementation 

Thirty students were selected for participa- 
tion in the project. These students were 
drawn from two units of work; Compute . 0 
I and Methods and Statistics in Social Sci- 
ence. The first unit is from the Industrial 
Mathematics and Computing degree 
course at Mitchell and the second is z u^tt in 
the Social Science degree course at Mitch- 
ell. Both units are first semester units. The 
project had two groups of 15 students, one 
studying &e social sciences and the other 
studying the introductory computing sub- 
ject that required them to learn Pascal pro- 
gramming techniques. 
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These students were asked to attend a day 
long briefing session at the beginning of 
autumn semester 1987. During this session 
they were to receive their IBM JX micro- 
computers and also learn how to use the 
following:- 

1. PCWS (Communications program) 

2. Modem connection 

3. The IBM MUSIC editor and environ- 
ment 

4. PC-Write (Word processing program). 

The students were issued with a manual 
detailing function key sequences, Austpac 
connections, a tutorial (brief) on using PC- 
Write and other technical information 
needed to use the complete system. The 
two groupsof students were briefedon two 
different occasions at Mitchell College. 

The students were also given a network 
user identification (NUI). This is used for 
accounting with the Austpac system. The 
students were trusted not to abuse the use 
of the NUI. The College paid the bills that 
accrued through the use - of the two NUIs 
that were given out one to each group of 
students. Thestudentsonlyhadiopayfor 
a local ca 1 ! when using the Austpac NUI. 
This is not nect^rily a definitl *e arrange- 
ment and will change according to circum- 
stances. 

Study ^to/lie 

The two sets of students had different 
study needs from the project. Tne social 
science students were studying a unit that 
was split into two distinct sections over the 
semester. The first section required them to 
learn some basic statistics for later applica- 
tion to social science problems. The later 
section consisted of essay type assignments 
on various social science topics. These 
students were able to use an elementary 
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CAL program on the mainframe to revise 
and learn some elementary mathematics 
work as well as participating in a regular 
conferencing session every 2-3 weeks. 

At the beginning of these sessions, the lec- 
turer would pose a controversial topic and 
invite discussion on the topic using elec- 
tronic memo techniques from the partici- 
pating students. Both of these uses of the 
mainframe were voluntary and were not 
part of the required coursework of the unit. 
Students were also encouraged to uje the 
PC-Write package at home to wordprocess 
assignments used in the latter part of the 
unit and then to electronically transmit 
them to College for marking. 

The computing students on the other hand 
were required as part of their unit to com- 
plete 8 assignmen ts tl t required the appli- 
cation of the Pascal progranr.iing lan- 
guage. The first assignment was a written 
one, but the other 7 assignments needed to 
be run and developed or* a computer. For 
these students an IBM Pascal compiler was 
available on the IBM 4361 as well as the 
required data sets to be used in each of the 
assignments. These students were to use 
the computer as an integral part of their 
assessab'e work in the computing unit. 

All students were able to make use of the 
electronic mai! facilities to leave or read 
memos for lecturers or other students. 
Another facility that was available was the 
access to library facilities using the 
CLANN library system. This system al- 
lows access to a database of library titles 
and topics from vanous participating li- 
braries. Mitchell students are able to re- 
quest these books required. 

Results 

At the end of the autumn semester 1987, a 
questionnaire was sent to all participating 
students. An additional questionnaire was 
sent to the social science students concern- 



ing topics that applied only to these stu- 
dents. 

Prelimi r vry results from this project can be 
broken do two groups: technical and 
educational. 

Computer Usage and Empirical Results 

The project had as one of its aims the inves- 
tigation of the technical feasibility of estab- 
lishing a micro/mainframe link and to 
gather some facts on the establishment and 
running of such a link. After an initial time 
in early March 1987, most of the students 
had mastered the technical problems of 
establishing a usable linkage from their 
homes to the mainframe at Mitcheil Col- 
lege. From answers in the questionnaire, 
the average time to become familiar with 
the equipment was 2-3 weeks. 

From the 16th March 1987, records were 
kept of machine usage on the IBM. The 
accounting files were processed using 
some application programs and relational 
database techniques to produce a file with 
only student logon information. This con- 
sisted of a relational table with the attrib- 
utesof logon identification, type of student, 
connect time, connect port, time of connec- 
tion, date of connection and an IBM IPL- 
identification value. From this table three 
figures of interest arise. 

Figure 1 shows the hourly usage of the 4361 
during the day. The results show what 
would normally be expects, that is, most 
students use the machine from early after- 
noon through to approximately 2300 
hours. It should be remarked that this 
figure includes weekends, which partly 
explains the low usage of the computer link 
during working hours. 

Figure 2 shows the usage by day of the 
week. Monday is taken as day 1 and Sun- 
day as day 7. Again the usage is as ex- 
pected, Saturday, Sunday, Monday and 
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Figure 1: A graph of the hourly usage of the IBM 4361 connected to the LAN at Mitch- 
ell College 



Tuesday are the heavy usage days. The last 
figure shows the connect time and the day 
in semester. From the graph it can be seen 
that the usage by the social science students 
tailors off as the semester progresses. This 
may reflect the approach of exams and the 
lack of any real need for the computer ex- 
cept for transmission of asisgnment mate- 
rial. 

It is interesting to note that usage of the 
machine was minimal oyer the Easter 
breal (days 20,21,22 on the graph). The 
usagp of the machine by the computing 
students is again what might have been 
anticipated: sharp peaks of usage when 
assignments are due! All the figures pro- 
vide some empirical data on micro/ main- 
frame usage. The data does not include 
access to the CLANN library system or 
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development work done on the microcom- 
puter at the students' homes. The total 
usage of the system is given in Table 1 . 



Table 1 
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Total 
Hours 



Average / 
logon day 



Computing stud. 


304.62 


4.35 


Social Science 


134.82 


2.32 


All Students 


439.44 


6.01 



Column two of Table 1 shows the average 
computing time per day for the indicated 
students. 

Educational Results 

The results presented here are a result of 
analysing the questionnaire and other re- 
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Figure 2: A graph showing the usage of the IBM 4361 connected to the LAN at Mitch- 
ell College for each day of the week. 
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sponses. A selection of questionnaire re- 
suits are presented in brief form in Figure 4. 
Students were given a scale of 1-10 from 
which they could reply to questions on the 
questionnaire form. Students answering in 
the range 4-6 were put into the unsure 
category in Figure 4. 

From the results given in Figure 4 it is easy 
to see that the students generally wel- 
comed the use of the microcomputer in 
their studies at Mitchell. Some responses 
reflected distinctive biases from each of the 
selected student groups. This difference is 
shown quite clearly in the response given 
in question 11 (interaction with other stu- 
dents). In the social science group, 6 of the 
9 responses agreed that they benefitted 
quite markedly from interacting via elec- 
tronic memo with other students. In con- 
trast, the computing students stated that 
they did not use the opportunity to send/ 
get memos from other students very much 
and it was not all that helpful. At this stage 
we can only conjecture at the reasons for 
this response. It is worth noting, in connec- 
tion with the results from question 11 , that 
all the students indicated that the electronic 
memo facilities were relatively easy to use 
and no clear bias was seen from either 
group on this question. 

Another topic that showed a clear bias 
between the two groups was that of benefit 
of the facilities in doing assignments. Eight 
of the nine responses from computing stu- 
dents agreed that they had a definite ad- 
vantage over other students in their unit by 
using the microcomputer/mainframe lin*. 
The explanation for this seems to be that 
doing computer assignments interactively 
is far superior than doing them via Austra- 
lia Post. It is suprising that the social science 
students did not think that they had an 
advantage over other students in the unit. 

Questionnaire Responses 

All the students agreed that more time 
should ha . w been allowed in getting them 
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Figure 4: Summary of some questions 
asked of the project students at the end of 
the semester. 



acquainted to using the computing link. 
This area of the project can be improved 
using past experiences and having learnt 
what are the common mistakes and needs 
of the beginning student. Improvements 
have been made as the project progresses. 
One such improvement was the writing of 
a simple logon procedure that made dial- 
ling up and logging on much easier. 

The social science students responded that 
they spent less than 12% of their time using 
the remedial mathematics program 
(MATHE) that was set up using a CAL 
package supplied by IBM. This was quite a 
surprising result. 

The conferencing sessions was another 
area where the usage by the students was 
very disappointing ( 15% of their time). 

The use of the wordprocessing package 
was rated very highly by the social science 
students. Most of the time was spent in 
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sending assignments to College ( J 20% of 
their time) and in sending/reading elec- 
tronic mail ( J 30% of their time) 

The final grades obtained from exams by 
students in both groups was of a high stan- 
dard (a number of distinctions and A 
grades), but no significant results can be 
reported due to the project selection criteria 
not being completely random and the small 
sample size. However, the general level of 
grades gave an indication that the use of the 
micro/mainframe link was beneficial and 
the use of a more rigorous experiment 
might perhaps be able to determine 
whether students' grades are influenced by 
having access to a computer linkage as 
described in this paper. 

Another interesting, although not unantici- 
pated, result emerged from the computing 
students. This was the abandoning of the 
use of the IBM Pascal compiler to use the 
Borland product, Turbo Pascal. This was 
because of the ease of use of this product 
compared to debugging a program over a 
phone line. 

There was a general feeling amongst all of 
the students to have a small printer avail- 
able with the microcomputer. 

The majority of students ( 95%) stated quite 
strongly that the use of electronic mail in 
contacting lecturers and other students 
was their greatest benefit. This contact with 
the College and having almost immediate 
response made the students feel "as if we 
are part of the student body". The use of 
electronic mail seemed to reduce the sense 
of isolation for students studying in the 
external mode and made some of them feel 
that they were not being doubly disadvan- 
taged by not having access to large city 
libraries and postal services. 

Conclusion 

The project has provided Mitchell College 
with some valuable experiences in organis- 



ingand incorporating the use of microcom- 
puters in the teaching of some external 
units. 

The preliminary results of this pilot project 
indicate that the students do benefit from 
the use of a microcomputer at home linked 
up to a mainframe at College, this linkage 
being an integral partofa students' studies. 
The use of electronic mail aspartof aunitof 
workhasprovedtobeofbenefitto students 
and staff. However, no conclusions can be 
drawn from this pilot study about the 
ramifications of such computer technology 
on the final exam results. 

The second goal of the project, that of inves- 
tigating the feasibilty of establishing a reli- 
able computer linkage, has shown very 
promising results. The establishment and 
maintenance of a reliable, remote comput- 
ing environment for students throughout 
the semester, has proved to be one of the 
successes of this pilot project. It has been 
demonstrated that a section of studies at 
Mitchell College can beenhanced and have 
incorporated successfully into it a micro- 
computer/mainframe linkage that pro- 
vides students with a better means of 
communication and study than that which 
presently exists. 

The project has given some preliminary 
facts on which to base any further work. 
The project has established an organisa- 
tional and educational framework for fu- 
ture developments in the use of computer 
enhanced distance learning. It remains to 
be seen how other units of study can be 
adapted to exploit this particular technol- 
ogy- 
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Quality distance education = computer 
based feedback + electronic mail 

Donald Munro 

School of Information Studies 
Riverina-Murray Institute of Higher Education 



The Riverina-Murray Institute of Higher Educa- 
tion offers a Post-graduate Diploma in Com- 
puter Applications. The course is offered only 
externally and utilizes AUSTPAC as the prime 
instructional and communication medium. The 
paper describes the types of facilities which have 
been investigated and developed, in an attempt 
to provide an enhanced learning environment 
for the external student Two of the facilities 
discussed are the use of ELECTRONIC MAIL, 
and COMPUTER BASED FEEDBACK. The use 
of Electronic Mail has meant that the external 
student can have the same types of regular 
communication with lecturers which an on- 
campus student takes for granted. Computer 
Based Feedback has provided a periodic assess- 
ment mechanism, controlled by the student, 
which highlights areas of learning difficulty by 
directing the student to material in the pre- 
scribed texts and notes. The combination of these 
facilities has proved highly effective. Not only 
has the marking load on staff resources dropped, 
but students are able to ask questions relating to 
their particular difficulties, and receive direct 
advice on overcoming those problems. 

A lot has been said and written about the 
benefits which could be achieved in dis- 
tance education by the utilization of mod- 
ern communications technology. At the 
Riverina-Murray Institute of Higher Edu- 
cation in Wagga Wagga, the approach 
adopted by the School of Information Stud- 
ies has been typically careful and low key, 
with the Institute proposing a Post-gradu- 
ate Diploma in Computer Applications in 
early 1985;. the Diploma commenced with 
an initial intake of 28 students in June of 
that year. The Course was distinctively 
unique in that it was offered only externally 
and utilized AUSTPAC as the prime in- 
structional and communication medium. 



Students were to purchase and install ter- 
minal equipment in their place of study. 
Now, two and a half years later, several 
salient features of this style of education 
have emerged which are worthy of men- 
tion. 

The Institute is no stranger to the task of 
teaching computing. In 1979 an Associate 
Diploma in Computing was introduced, in 
the full-time, part-time and external stud- 
ies modes. This course has always filled its 
quota of student places, and it was the 
persistent demand in the external mode 
from applicants already possessing an 
academic qualification which led to the 
development of the post-graduate of fering. 
In the last five years, pressure from external 
students possessing their own micro-com- 
puters encouraged the Institute to install 
three DIAL-UP lines to the Academic VAX 
11/780 and 8200 computers. This facility 
allowed the preparation of programs and 
data off-line, followed by concentrated 
periods of transmission during the STD off- 
peak periods. Students utilizing these fa- 
cilities made generally better use of the 
time available to them during residential 
schools, learned more and achieved better 
academic results. In short, a higher qualify 
of distance education was being achieved 
through little more than providing appro- 
priate hardware. 

The introduction by Telecom of the aUST- 
PAC Communication facility presented a 
challenge to the computing lecturers: 



kERJC 



i 5 7 



148 



Using Computers Intelligently 



With the removal of punitive STD charges, 
to what extent could extensive access to 
existing and newly developed software 
packages, support and enhance the learn- 
ing opportunities for the External Student? 

The Post-graduate Diploma in Computer 
Applications concentrates on six major 
aspects of computing. The student is pro- 
vided with: a comprehensive program- 
ming background; a solid understanding 
of computer management; a good knowl- 
edge of fourth generation facilities; the 
fundamentals of data base design and data 
communications/ and experience using 
Structured Analysis Techniques. A final 
individual case study major project draws 
together the student's newly acquired 
knowledge and experiences. 

The course, which consists of two years 
part-time external study, commences in 
June with a five day residential school. 
Unlike residential schools in the Associate 
Diploma, where the emphasis is centred 
around practical tuition and computer 
access, in this residential school the Post- 
graduate Diploma students are oriented to 
the Institute and its expectations of them, 
the equipment which they will be accessing 
from their remote locations and the lectur- 
ers they will be interacting with (sight 
unseen) for the following two years. Ex- 
amples of appropriate terminal equipment 
and the use of AUSTPAC are also covered, 
together with a general introduction to 
LOGGING-ON, and using the HELP and 
electronic MAIL facilities. 

The distinguishing feature of this course is 
the use of the AUSTPAC communication 
facility as the primary communications 
link between the student and the lecturers 
involved. 

As these students have 1.0 extensive back- 
ground knowledge of computers (there is 
no pre-requisite computing knowledge), 
the residential school also allows inspec- 
ts j 
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tionof the VAX computing facili ties, so that 
students have an idea of the location of the 
machinery with which they will be inter- 
acting. This is an important concept to 
establish, as most of the students' home 
terminals will be micro-computers with 
their own processing and storage facilities. 
We wish to distinguish between "local" 
and "host" storage and processing, and the 
various communications between them. 

Student equipment 

During the design of the course, the Insti- 
tute lecturers looked at the advantages 
which would accrue from definitively 
specifying the equipment which the stu- 
dent had to acquire. Standardization 
would allow the preparation of programs 
which could be "down-loaded" and RUN 
in LOCAL mode, and would allow the 
exploitation of graphics and colour. In 
addition, the equipment could be com- 
pletely checked out and the support effort 
would be reduced. On the other hand, 
many potential students already had com- 
puter equipment which would be suitable 
for textual transmission, and regardless of 
which equipment was standardized upon, 
it would be obsolete in a relatively short 
period of time. The decision to remain 
centred on the Institute VAXs was made on 
the basis of: 

• the relatively small amount of graphics 
and colour related instruction 

• insufficient staff to develop a new set of 
programs centred around a particular 
micro-computer 

• the existing set of programs used in the 
Associate Diploma and based on the 
VAX being seen as providing a good 
base of appropriate material for the 
Post-graduate Diploma students. 

The introductory programming subject (a 
full year subject) is taught using the BASIC 
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language. Other languages were consid- 
ered. However, as most of the micro-com- 
puters have BASIC built-in, and as the 
Associate Diploma course already used 
BASIC in its introductory subjects, any 
move to another language without signifi- 
cant advantages would have produced an 
unacceptable strain on staff resources. The 
pedagogical advantages of being able to 
test and run small programs in LOCAL 
mode was seen to be a great advantage, 
particularly when the same program could 
be uploaded and then run on the VAX. 

This approach works well because the ini- 
tial programming instruction concentrates 
on a STANDARD SUBSET of BASIC state- 
ments which are compatible across a wide 
range of equipment, rather then exploring 
the richness of various BASIC dialects. In 
most cases initial programs ran in LOCAL 
and HOST without change, and more ad- 
vanced programs required only a few 
global changes using the EDITOR {which 
had been taught by that stage). Another 
advantage of this approach is that the stu- 
dent develops a respect for the power and 
flexibility of the micro being used; the 
"even my own machine can do it" syn- 
drome. In fact some students took great 
delight (and spent many hours) converting 
advanced examples provided on the VAX 
into versions which would run on their 
own machines. The value of this to the 
educational process is self-evident. 

Electronic Mail 

Most exercises and assignments are sub- 
mitted on the VAX by electronic mail. 
Using this approach, the student tests and 
runs programs on the VAX until ready for 
submission. In this process a sample execu- 
tion of the program may be captured into a 
log file which will show all of the interac- 
tion. The student then concatenates the 
Input and Output files, the program listing 
and any captured sessions into a single 
"submission file" using the COPY state- 



ment. This submission file is then MAILED 
for marking. As well as each lecturer hav- 
ing a personal account on the VAX, there is 
a class account for each subject. The studen t 
activates a "HANDIN" procedure which 
automatically transfers the submission file 
to the class account and an ACKNOW- 
LEDGEMENT OF RECEIPT is sent back to 
the student. 

Students may also MAIL questions directly 
to the lecturers' personal accounts. In the 
case of a lecturer being absent from duty, 
that message will remain unanswered for 
that period of time. Of course if the lecturer 
is simply off-campus {at home, at a confer- 
ence), then by using portable terminals the 
communication with the students can be 
maintained regardless of physical situ- 
ation. I have even used a portable terminal 
from a telephone box in Melbourne while at 
a conference in that city, and have been 
successful in establishing communications 
even through switchboards with STD bars 
in larger organizations. 

By retaining a separate electronic mail 
FOLDER for each student in the class ac- 
counts, the lecturers have access to the total 
history of submissions, acknowledge- 
ments, questions and answers which have 
passed between the Institute and a student. 

Another feature of electronic mail is the 
BROADCAST facility which allows a lec- 
turer to send a message to all usernames on 
a distribution list. This allows for easy and 
efficient communication of general notes, 
explanations, and words of encourage- 
ment, and because each student must 
communicate with the system twice a 
week, the lecturers can assume that such 
messages are received. The number of 
LOGINS and duration of connection are 
stored in the VAX Operating System LOG 
and the statistics can be distributed to both 
lecturers and students. 

Electronic mail is not restricted to commu- 
nication between the Institute and the stu- 
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dent but also facilitates STUDENT TO 
STUDENT communication. A number of 
individuals make regular use of mail to 
share difficulties and approaches to solu- 
tions, and there was a 'TUTORI AL" hour 
established by some students for the ex- 
change of pressing problems. 

The use of CAI techniques 

With such a brilliant communication facil- 
ity it was natural that approaches would be 
made to include elements of CAI into the 
main stream educational material. Within 
the Associate Diploma there are already 
three packages, provided by Digital Equip- 
ment Corporation, which are used in a tuto- 
rial instruction mode. These are not avail- 
able to the majority of Post-graduate Di- 
ploma students because they require 
VT100 compatible display terminals and 
single keystroke responses rather than line 
oriented responses (this is a costing restric- 
tion rather than an AUSTPAC restriction). 

The CAI 'TUTORIAL" method, while of- 
fering an enormous potential for individu- 
alized instruction, also places a significant 
loadon staff time in the development phase 
of the tutorial construction. Various 
sources have quoted a ratio of 100:1 (100 
hours of staff time required to produce 1 
hour of tutorial). Again, even though there 
will be savings in staff time once the tutorial 
programs are in place, the shortage of staff 
time for the development cycle renders the 
tutorial approach practically unviable at 
present. 

The first local CAI developments have fo- 
cussed on reducing the amount of hack 
marking by lecturers, and improving feed- 
back of results to students. 

Marking programs 

The first of these required the students to 
create a file of answers to multiple choice 
questions and then to MAIL the file as a 
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submission. Once the submission arrived 
at the class account, the file was read into a 
marking program which tallied the score 
and MAILED the mark, grade and correct 
answers to problem questions back to the 
student. These marks were then automati- 
cally transferred to a spreadsheet for as- 
sessment determinatio n by the lecturer and 
for other statistical operations (e.g. correla- 
tion between student responses). 

Computer based feedback 

The second program to be developed actu- 
ally asked the student the questions and 
accepted the answers interactively. The 
program allowed the student to move for- 
ward or backward through the questions, 
or tc jump into a particular question. There 
was also the facility for asking for help with 
the question where more details of what 
was required would be given. When the 
answering of questions was completed, the 
program would then tell the student the 
mark which had been achieved (without 
indicating the questions which were an- 
swered incorrectly) and it would list the 
page numbers of the text and the notes 
containing the information relevant to the 
incorrectly answered questions. The stu- 
dent then had the option to submit the 
current attempt, or to re-read the references 
and then answer the questions again. The 
student decided what level of mark (and 
effort) was acceptable; there was no restric- 
tion on the number of attempts by the stu- 
dent. If an attempt was to be submitted 
then the program would MAIL the answers 
and the marks to the class account for proc- 
essing as earlier described, except that in 
this case the student already knew the 
mark for the submission. 

This second program is used in an Intro- 
ductory Systems Analysis subject which is 
based around a fairly large and detailed 
text. The students find reading the text 
quite a chore, and often skip or skim read 
sections. Traditional methods of motivat- 
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ing students to do this reading thoroughly 
would require the setting of various discus- 
sion questions or short answer tests. To be 
of best use, these in turn would have to be 
quickly marked and have comments at- 
tached, before being returned to the stu- 
dent. There are insufficient staff resources 
to allow this approach to be effective. 

The Computer Based Feedback approach 
breaks the 100:1 ratio of the tutorial ap- 
proach (VAX based and PC based pro- 
grams in use have typically a 10:1 ratio), 
because most of the required questions 
being presented in the exercises are avail- 
able as True/False or Multiple Choice 
questions to be found in most instructor's 
manuals. All that remains is the task of 
locating a page reference which will assist 
the student should the incorrect answer be 
given. By allowing multiple attempts at the 
set of questions, most students do not just 
accept the grade and go on to the next task, 
but rather review the references and try 
again. This can be contrasted with the tradi- 
tional testing methods where students will 
often not review the results of a test and, in 
some cases, not even read the comments 
appended to their submissions. 

In fact, the motivational aspect of using this 
delivery method became apparent when 
we included a counter of the number of 
attempts which individual students were 
making at the tests. These ranged from 4 or 
5 up to 20 to 30. In an attempt to reduce the 
pressure on terminal lines we distributed 
printed copies of the questions, so that 
students could note down answers as they 
read the text. This decreased the duration 
of each test (as the student did not have to 
carefully read the question as presented), 
but had only minimal impact on the num- 
ber of attempts. 

Exam results 

When we compared the final exam results 
of the post-graduate students with a group 
of on-campus degree students who also 



used the same text and sat the same exam 
(but who did not have access to the Com- 
puter Generated Feedback), we found that 
while the distribution of marks was similar, 
the post-graduate students' results were 
centred around a higher mean. In the fol- 
lowing semester we made the CBF system 
available to the next group of on-campus 
studen ts and experienced a similar upward 
shift in the mean mark for that group. A 
dramatic upward shift in mean for a cohort 
of Associate Diploma in Computing stu- 
dents, who were also allowed to use the 
CBF system, occurred in the same semester. 

The quite dramatic increase in perform- 
ance, as measured by the examinations 
(consisting of 100 short answer questions), 
has also been noticed at QIT following the 
introduction of Computer Based Training 
programs by the Educational Research and 
Development Unit (ERDU), and reported 
atCalite'86 (1). 

Reasons proposed for this success have 
been: 

• that a lot of students no longer study 
effectively; be this due to lack of knowl- 
edge about how to study, or lack of 
motivation (2) 

• that with this method the student is 
provided with only positive feedback, 
and references to the correct answers, 
and so the student does not "learn the 
distractors" (3) 

• that using the computer to answer the 
questions sustains an interest in the 
subject material which not only extends 
the time a student spends on the mate- 
rial, but also makes that time more effec- 
tive (4). 

Conclusion 

Whatever the reason, Computer Based 
Feedback seeiTis to: 
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1. WORK, in the sense that students 
achieve a better learning program re- 
gardless of their distance from the Insti- 
tute. 

2. WORK, in the sense that students get 
appropriate feedback at the time of 
submitting their answers. 

3. WORK, in the sense that lecturers are 
freed from repetitious marking and 
record keeping, and can devote time to 
addressing areas of difficulty identified 
by the incorrect answers to particular 
questions. 

When Computer Based Feedback is com- 
bined with a fast response electronic mail 
system, and is provided over a low cost 
communication facility, the effects of the 
physical isolation of the external student 
are significantly reduced. 
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A case study in computer education by 
external study 



John A Palmer, Ken Peirce, and Graham Pervan 
Curtin University of Technology 



This paper covers the introduction of a Busi- 
ness Systems unit to the Bachelor of Business 
degree at Curtin University of Technology and 
the changes in teaching approaches and tech- 
niques which became necessary when it was 
decided to make the unit available to external 
students. EDP Systems 200 was developed in 
1984 with the objective of providing an intro- 
duction to Data Processing and Programming 
for second year Accounting students. It became 
a required unit for their studies and was taken 
as an elective by students elsewhere on the 
campus. 

In 1986 it was decided that the unit should be 
made available to external students through- 
out Western Australia because many Account- 
ing students were held up in their studies 
through not being able to study EDP Systems 
200 which was a pre-requisite for other units. 
This unit was designed in 1986 and imple- 
mented for the first time during the Autumn 
Semester 1987. 

This paper describes the design/ implementa- 
tion and problems associated with bringing a 
unit with many different requirements to a 
relatively small number of students spread 
over a vast area. 

External Studies at Curtin 

From its inception in 1968 the Western 
Australian Institute of Technology (now 
Curtin University of Technology) has rec- 
ognised that it has a responsibility to pro- 
vide tertiary education to WAIT students 
regardless of their location, age, status and 
domestic or work responsibilities. These 
problems frequently mean that students 
are unable to complete studies in the nor- 
mal internal mode. 



In order to overcome these inherent prob- 
lems Curtin offers Undergraduate and 
Postgraduate programmes for external 
students in the areas of Business and 
Administration, Arts, Education, Social 
Sciences, Engineering and Science, Health 
Science and Mining. A total of thirteen 
courses are available entirely by external 
study and a further twenty seven are par- 
tially available. The majority of the stu- 
dents enrolled in these courses are located 
over widespread areas of Western Austra- 
lia, and in addition there are significant 
numbers of students who live in other 
States and overseas. 

External Studies in Business 

In addition to a general Graduate Diploma 
in Business, the Division of Business and 
Administration offers three of the Majors 
from its undergrauuate Bachelor of Busi- 
ness degree; these are Accounting, Finan- 
cial Management and Economics, and 
Marketing. In addition, some Graduate 
Diploma courses are also offered through 
external study. All five Schools within the 
Division are involved to some extent, due 
to the fact that the degree includes a com- 
mon core of units from each School. Three 
of the Schools which also offer a major have 
greater involvement. The amount of in- 
volvement in external studies for any par- 
ticular unit depends on the degree of diffi- 
culty in conducting that unit over large 
distances. 
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The School of Computing and Quantitative 
Studies services two of the common core 
units and one of the specialist units in the 
Accounting Major, EDP Systems 200. 

EDP Systems 200 at Curtm 

Historical background 

In 1984, at the last review of the Bachelor of 
Business Degree, it was agreed that all sec- 
ond year Accounting students should 
study a unit which would give them some 
knowledge of both data processing and 
programming, including hands on experi- 
ence with microcomputers and an IBM 
type mainframe computer. 

A course was prepared for on-campus stu- 
dents. It was a five hour per week unit 
made up of studies in the following areas: 

• Data Processing 

• Introduction to dBASE II 

• Introduction to COBOL programming 

After two semesters it was decided that 
COBOL did not satisfy the objectives of the 
unit and another mainframe programming 
language was selected. The program cho- 
sen was SAS, which was easier for non- 
specialists of computing to learn on the 
Amdahl computer because it removed the 
need for the students to overcome the 
complexities of Job Control Language 
(JCL) and concentrate on quickly develop- 
ing applications. In addition, it provided a 
sound preparation for the use of the lan- 
guage later in the study of Auditing. 

In 1986 dBASE III was introduced to re- 
place the earlier dBASE II. This has been 
retained for 1987, but will be upgraded to 
dBASE III Plus for both internal and exter- 
nal students next year. 

The unit has proved satisfactory as an in- 
troduction to these key areas and many 
students are using it as a stepping stone 

O 



into further computer studies. In addition 
some faculties other than Business have 
made the unit part of their curriculum. It is 
now usual for over 400 students to enrol in 
EDP Systems 200 each year. 

The unit requires students to attend lec- 
tures in each of the three segments, work- 
shops for the programming sections and 
tutorials for the data processing compo- 
nent. 

The student evaluation consists of continu- 
ous assessment for the D.P. area; this is 
made up of case study work plus tests and 
an examination. The programming sec- 
tions are assessed from hands -on assign- 
ments carried out in the workshops. 

In 1986 it was agreed that EDP Systems 200 
should be made available to external stu- 
dents spread over Western Australia, but 
not open by external study to students in 
the Metropolitan area of Perth. This deci- 
sion was made to avoid the overscheduling 
of available laboratory facilities (already 
highly utilised) for internal student 

Developing the External Unit 

The idea of using computers or learning 
some aspect of computing by external 
study is not new. The Open University has 
been doing this since the early seventies 
(Bramer, 1980). In the case of EDP Systems 
200, there were specific problems which 
appeared different from other attempts. 
Other hands-on computing units have of- 
ten involved the study of the BASIC lan- 
guage (for example, Jennings and Atkin- 
son,1982). As EDP Systems 200 involved 
some IBM mainframe requirements as well 
as microcomputers and a mix of applied 
systems software, these past experiences 
were of little use in developing this unit for 
external study. 

There were three main problems to be dealt 
with due to this overall decision. The first 
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one was to convert the Data Processing 
segment from a lecture and tutorial mode 
to a format compatible to distance learning 
concepts. The second problem was to 1e- 
velop a microcomputer nands-on" seg- 
ment for dB ASE in which could be handled 
by students in remote areas with very little 
reference to Curtin University. The third 
goal was to create a teaching programme 
for SAS on suitable mainframe computers 
in remote areas.The authors of this paper 
were given the responsibility of producing 
this programme by the end of October 1 986 

Before any of these activities could begin, it 
was necessary to ascertain the interest and 
likely enrolment of eligible students and 
also to find out the possible availability of 
both microcomputers and IBM type main- 
frame computers in the country centres. A 
circular was sent to all prospective students 
explaining the format of the total unit, 
advising of the availability of the unit in 
1987 and requesting a response regarding 
the student access to both IBM compatible 
PCs and mainframes. In addition, teaching 
institutions in country areas were con- 
tacted to see if any of the facilities needed 
were available at these centres and if so, 
what conditions would apply to the use of 
their equipment and teaching staff. 

The overall response to these letters was 
good. There were over thirty replies and 
from the information given it was apparent 
that the bulk of the students would be able 
to gain access to microcomputers. Many 
had PCs at home, others had them at their 
work place and other individuals were able 
to use equipment at local High Schools. 
This meant that there was no need to use 
the institutions which had been contacted, 
although there had been good support 
from those bodies. 

The response regarding the availability of 
mainframes indicated that it would not be 
feasible to handle this segment of the 
course off campus and plans were made to 



conduct a concentrated course on SAS at 
Currin University during the extended 
Easter break. 

Once this information was at hand it was 
possible to commence preparation of the 
course material. In the areas of Data Proc- 
essing and dB ASE IE, a series of topics were 
selected and readings were chosen to sup- 
plement the topic presentations. A variety 
of exercises, both assessable and for prac- 
tice, were included in the topic material, so 
as to provide a comprehensive set of study 
notes for the students. For SAS a set of 
introductory notes were prepared, so as to 
give the students a basic idea of the lan- 
guage prior to attending the session on 
campus. 

Once enrolments were completed in Febru- 
ary 1987, all students were telephoned to 
determine the type of PC which was acces- 
sible and whether all students would be 
able to attend the on campus session at 
Curtin for the SAS. Answers to these ques- 
tions indicated that the students knew the 
requirements before hand and they all 
appeared able to conform to the pro- 
gramme. Questions from students were 
dealt with and they were left with a clear 
understanding of the objectives and format 
of the unit. 

This initial contact proved very helpful, in 
that the students commenced their studies 
with very few problems and misconcep- 
tions about the unit. They knew what to do 
and they already had received personal 
counselling from their contact in the unit. 

The Outcomes of the First Run 

Following the unit development as de- 
scribed in section 2.2 above and after the 
communication with the students and any 
necessary counselling, it was agreed that 
the unit was ready for a trial and it was run 
in the first semester of 1987. The activities 
involved in each section of the course and 
the overall outcomes are set out below. 
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General D.P. Section 

The data processing section was generally 
saitableforchangingfrominternalmodeto 
one satisfactory for use with external stu- 
dents. The general principle was to use the 
text book (Principles of Data Processing, 
Ralph J. Stair) as a basis for learning about 
hardware and software. Readings and 
other references were used to supplement 
any deficiencies in the chosen text book. It 
is usual that one book will rarely cover all 
the topics in a set curriculum. The first task 
was to develop individual modules for the 
unit, each of these to cover a specific sec- 
tion, such as Computer Input If the text 
book adequately covered the area the 
iTixlules were not large, but they were 
e> tended if it ^rzo considered that the text 
coverage was insufficient or if the particu- 
lar topic was not dealt with at all. There 
were exercises within the text book which 
the students were expected to complete. 
These were used for practice only and were 
not assessable. Assessable exercises were 
provided for areas no* covered by the text 
book and were also usea to test whether the 
students were able to use the knowledge 
gained in practical circumstances. An ex- 
ample of this was a case study dealing with 
an organisation which was having prob- 
lems with its data processing and was 
considering introducing a new computer 
system. Other exercises dealt with areas 
such as Data Flow Diagrams and Cost/ 
Benefit Analysis which were not covered to 
any degree in the text. 

The final assessment was an end of semes- 
ter examination which mainly covered 
material from the relevant parts of the text 
book. 

dBASE III Section 

The objectives of the dBASE III section 
were several. One was to give the students 
adequate exposure to microcomputers, 
handling floppy disks, formatting, copying J 



files, backing up data, and appreciating the 
role of the operating system. Secondly, we 
wanted to expose the students to concepts 
of data storage, fields, retards and files, 
and how data in files can be accessed. The 
vehicle chosen for the achievement of these 
objectives was dBASE III, although origi- 
nally the course had been based on dBASE 
II. 

The largest single task in preparing the 
dBASE III part of the course was writing the 
external notes for students. Fortunately we 
had a good basis for starting these notes. 
For several vears we had been teaching 
dBASE n and dBASE III to the public and 
providing detailed notes as well as sample 
data. These notes provided the basis for the 
external course notes. 

A complete set of internal course notes does 
not suffice for an external course, how , er, 
and much of the material had to be re- 
written. Unlike teaching in a classroom or 
even a laboratory, in distance learning the 
notes are the students' only source of infor- 
mation. It was necessary, therefore, to in- 
clude in the notes sample screen layouts 
and detailed explanations which were not 
part of the original notes. We knew that the 
first set of notes would be experimental and 
that a significant re-write would be re- 
quired for the second offering of the course. 
As this wasa significant part of the teaching 
in th~ undergraduate Accounting degree - 
in fact the students' only exposure to mi- 
crocomputers - we knew we had to put a lot 
of continuing effort into the development 
and refinement of the notes. 

Although we were licensed to copy and 
distribute a tutorial version of dBASE III, 
we could not provide our external students 
with any version of MS-DOS. Our internal 
students were provided with the software 
legitimately but the external students had 
to find it themselves. Many of them did not 
knovv what an operating system was, let 
^o^ how to acquire MS-DOS! 
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Fortunately the solution to that problem 
was also part of the solution to the problem 
of the acquisition of hardware. Once the 
students had access to an IBM PC or com- 
patible, it was a simple matter to ensure 
that the student had a copy of DOS. The fun 
began when we started to get phone calls 
from students asking whether their par- 
ticular micro was an IBM compatible. 
There were machines we had never heard 
of before - neither had our computer centre. 

In time, we had all of the studentsequipped 
with PCs or compatibles as well as MS-DOS 
or PC-DOS. They needed compatible hard- 
ware because we were supplying dBASE 
m and several databases on 5 1/4 inch 
floppy disks formatted by MS-DOS. These 
disks did not contain any means with 
which to boot the system. That had to be 
done by the students' version of MS-DOS 
prior to loading our copy of dBASE III. 
Although we had no responsibility to pro- 
vide the operating system, we nevertheless 
took the responsibility of teaching the stu- 
dents how to use the micro, how to boot the 
system, copy files, rename files, look at the 
directory, and so on. A simple set of exer- 
cises had to be devised to enable the stu- 
dents to gain confidence in manipulating 
files under MS-DOS. This had not been 
done for the earlier course in dBASE HI 
offered to the public, so we had to under- 
take extensive writing of notes. 

The final, and somewhat late, aspect of the 
teaching of dBASE III externally was devel- 
oping an assignment for assessment. By the 
end of the dBASE section of the course the 
students had created their own databases, 
sequenced them in difference ways, ex- 
tracted data according to quite complex 
conditions, and reported on the data ex- 
tracted. It was not difficult to set an exercise 
to test a student's ability to create a report 
on a particular database. This was in fact 
done by using the CREATE REPORT com- 
mand. Similarly we could test the student's 
ability to create a database. The problem 



arose when we tried to test the student's 
knowledge of interactive commands, the 
execution of which we had no way of wit- 
nessing. It became necessary to teach the 
concept of stored commands; in effect we 
had to teach the students how to create 
programs. As it turned out, the students 
coped very well with the concept of com- 
mand files as well as being able to sequence 
and extract data from files and store these 
commands in a program. 

SAS Section 

The on-campus session used SAS on an 
Amdahl (a plug compatible IBM main- 
frame computer) and proved to be success- 
ful. At the startof the semester, the students 
were supplied with notes on SAS and its 
implementation on the Amdahl in a 
workpack. A "short answer" test/assign- 
ment was include with this material. This 
simply tested whether the students had 
read the material. It was required that this 
work should be submitted prior to the on- 
campus session. This material gave an in- 
troduction to the types of commands, 
screens and keyboard which the students 
would be using at Curtin. A concentrated 
three days made up of lectures (about one 
day) and laboratory work (about two days) 
enabled them to learn enough to write a 
reasonably complex application and then 
fully test and debug the program. All the 
students successfully completed this pro- 
gramming assignment and commented 
favourably on how much had been 
achieved in such a short time. 

The approach taken was similar to that 
previously used by the authors in the exe- 
cution of professional short courses for 
people learning the basics of SAS on an IBM 
mainframe. The methods used had proved 
successful in the professional courses and 
were no less so with these external stu- 
dents. In addition the students expressed 
appreciation for being given the opportu- 
nity for face to face contact with their lectur- 
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ers which is not usual in the isolation of 
normal external studies. 

Student Performance 

On the completion of the semester, 20 stu- 
dents out of the 22 original enrolments had 
completed all the requirements of the unit 
and all of these had achieved good results. 
The average result percentage was 72%, 
which is better than the average for other 
units. In addition the retention rate was 
very satisfactory. 

Student response 

Once the semester had ended and the re- 
sults had been distributed, a simple ques- 
tionnaire was sent to all students to deter- 
mine their reaction to the unit and also 
asking for any recommendations in regard 
to changes to the unit. The areas which 
were covered in the questionnaire are set 
out as follows: 

• Administration of the unit 

• Organisation of the unit 

• Academic content: 

Data processing 
dBASE III 
SAS 

General comments and 
recommendations. 

Due to the smallness of the group i t was not 
feasible to make valid statistical tests of the 
answers to the questionnaire, but the over- 
all response indicated that the students did 
nol believe that there was any need for 
major changes to the current format. 

Conclusion 

In summary, the first run of the course has 
gone surprisingly well. No major problems 
have arisen in any of the three parts of the 
course and so no major revisions are in- 
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tended for the next offering in first semes- 
ter, 1988. Student performance was above 
expectation and questionnaire responses 
indicate general satisfaction with the 
course. As expected, the general data proc- 
essing component ran smoothly, probably 
because the requirements were no different 
from a normal distance learning course, 
and there was plenty of experience to call 
upon in that area. The SAS component also, 
as expected, ran successfully, given the 
input of previous experience to its develop- 
ment. The greatest uncertainty lay in the 
success of the dBASE m section, but the 
care taken (and previous short course expe- 
rience) led to a successful outcome. 

In addition, early planning and contact 
with intending students well prior to the 
semester starting meant that there were 
very few administrative problems. The 
only changes contemplated for 1988 will be 
upgrading to dBASE IHPlusand reviewing 
the text books to ensure that those used are 
up to date. 
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John Palmer, Ken Peirce and Graham 
Pervan all teach commercial comput- 
ing for the School of Computing and 
Quantitative Studies and have done so 
since the School was formed in 1975. 
All the authors have been involved in 
the development of several public 
courses offered to the Perth business 
community in areas related to the selec- 
tion of microcomputer hardware and 
software, and programming in various 
microcomputer-based and mainframe- 
based software packages. 



16 9 



CAI — A necessity not a choice 

Douglas L. Carthew 
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This paper sets out to explain some of the reasons 
Computer Aided Instruction is not being used 
by Lecturers to prepare their own material for 
presentation of self directed learning. The sim- 
plicity of text based authoring to a large extent 
has not been adopted in the classroom. The 
writer has been involved in the development of 
a text based system suited to authoring by staff 
with minimal computer familiarity. The student 
has control at all times, and provision has been 
made for branching facilities based on response 
and time. Emulation of multi-field screens al- 
lows for business systems training, and vide- 
odisc access is also part of the program facilities. 
Widely available for evaluation in TAFE the 
program requires little more than word process- 
ing skills for preparation of text Few lecturers 
have elected to use the package. 

The integrated authoring facility devel- 
oped by pragmatic response to TAFE lec- 
turers requirements is the "Q" instruction 
package. This paper addresses the issue of 
introducing CA.I. into traditional class- 
rooms where computers are unfamiliar. 

Gassrooms are designed for presentation 
of a familiar lecture. C AX caters for the 
individual learner learning at their own 
rate, often in their own time. 

Professional Educators in TAFE (S.A.) 
were seeking alternative teaching methods 
and looking for a CAI. package which 
could be used on already purchased NEC 
APCm computers. This required the 
simple skills of a Wordprocessing Typist 
and the minimum management skills of 
lecturing staff. 



Aspirations for CA.I. 

Dedicated educators gain reward from 
student learning. The Richmond College in 
Victoria had pioneered the application of 
the package "Author". The package re- 
quired an IBM with Colour for graphics 
presentation. Skills required were minimal 
but suitable hardware had not been pur- 
char ed by TAFE in Adelaide. 

Many lecturers inspired to use Computer 
Assisted Instruction lacked the determina- 
tion and zeal to continue application of the 
most simple software. Graphics C.A.I, was 
left to the few with the necessary zeal. 

Pioneering S.A. TAFE efforts in C.A.I. 

The testbed for the emerging methodology 
will undoubtedly be the new college being 
developed at Tea Tree Gully, currently 
under construction. 

A pioneering site for the new technology 
using the "Q" package was Croydon Park. 
The College was an ideal environment in 
which to develop the package from a Uni- 
versity Module to a System for wide appli- 
cation in TAFE. 

The following screen illustrates the system 
options available within the package. 
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MAIN MENU 

Catalogue/EOIT existing TEXT 

Create new TEXT 

CONVERT session TEXT for use by Q . 
UN-CONVERT session files to TEXT . . 

Test-run Q 

Print a copy of CONVERTED TEXT 

Make an authoring work disk 

Create/Edit a USER authority list . 
QUIT 

Staff Development took place in conjunc- 
tion with the trials at Croydon Park and 
"Q" found application in Matriculation 
studies and Adult Literacy. 

Lecturer Hopes 

Student Directed Learning 

With packages written today using C.A.I., 
lecturers know the their needs and the 
students. The packages are available but 
when the time comes to convert prepared 
text for presentation on computer, the 
problems appear greater than the desire to 
improve methodology. 

Curriculum Question Bank 

Education administrators are applying 
pressure to meet rising costs and increase 
productivity. They are recognising the 
need to have lecturers more efficient but are 
not always committed to the application of 
computer technology and the costs in- 
volved ir. implementing the new method- 
ology. 

Administrators know that the curriculum 
can have assessment on computer. The 
"Q" package is capable of holding a ques- 
tion bank with all the questions for all the 
curriculum in 1 ArE on one large database, 
and when required, extracting questions 
for a lecturer from the database. The pro- 
gram exists but directors responsible for 
implementation need to be willing to give 



direction and implement the technology. 
Without the support of lecturers staid in 
traditional teaching methods administra- 
tors are doomed to failure. 

Off campus Tutorial 

Student learning is leaving the classroom 
and taking place at home. Adelaide Col- 
lege of TAFE is one of the leaders of dis- 
tance education in this country. 

More and more pressure is being applied 
by our society, by students who recognise 
the need for further education, and those 
seeking advancement in present or future 
employment. 

Many arebuyingcomputers to enable them 
to both study and prepare assignments. 
They can learn any subject with their com- 
puter using C. A.I, a i home and be assessed 
using the same package in the college. 

The following Illustrates the system op- 
tions available to the administrator/ man- 
ager/lecturer. 

MAIN MENU 

Modify session delivery options .... 

Recover data from a user disk 

Edit/read a QRESULT.TXT file 

Test-run Q 

Print a copy of session text 

Make a new user (student) aisk 

Create/Edit a USER authority list . . 
QUIT 

Misunderstanding 

Most new methodology comes under criti- 
cism with a resistance to change. C.A.I, is 
no exception. Lecturers resist, administra- 
tion fails to see value, and funding institu- 
tions are loath to spend the money. 

Administrative Direction 

Good managers are often misunderstood 
by educators who feel their creative teach- 
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ing efforts are unrewarded. Of all the func- 
tions in our society today, education needs 
sound direction. If senior management are 
unwilling to support change, then the en- 
thusiastic Lecturer will introduce new 
methodology "doing their own thing'' with 
unnecessary duplication of effort while 
looking for leadership. 

Coordination needed 

Innovation needs direction, and without it, 
an otherwise successful project may be- 
come a failure. Creative staff are difficult to 
manage and inventors are noted for work- 
ing outside guidelines which should be 
imposed. The development of C.A.I. re- 
quires a team effort, the support of a direc- 
tor, a willing typist and a facilitator who 
will participate in the development of the 
new methodology in the classroom. En- 
couragement s needed for the student 
participating in the use of the new method- 
ology. 

Work involved 

Computer Assisted Instruction requires 
both dedication to the machines use and a 
conviction that focus should b^ on the 
learner not the lecturer. The Lecturer must 
be persuaded that C.A.I. will aid in presen- 
tation of material in the same way that the 
overhead projector is used in the classroom 
or a slide-tape session may be included in 
the methodology. 

Enthusiasm 

Students greet Computer Assisted Instruc- 
tion with a zest born of a fascination with 
the new technology and the desire to 
achieve. Using C.A.I. in the classroom 
daily has convinced me of its value in most 
subjects. Students pair and answer ques- 
tions with both active participation and 
discussion. 

Students 

All students having overcome fear of tech- 
nology value simple self directed learning. 



The difficulty is not the student bui the 
lecturer feeling threatened by computers. 
The role for the lecturer changes with C A.I. 
to one of providing support for the learning 
environment. 

Lecturers 

Some lecturers have adopted Computer 
Assisted Learning, but the majority lose 
enthusiasm when the full realization of the 
commitment becomes known. Few realize 
that they already have much of the basic 
material prepared in lesson plan form and 
hand-outs. 

Success 

Success in alternative teaching methods is 
symbolized by the use of overhead projec- 
tors in the modern classroom. 

The recognition of student satisfaction in 
completion of a "Q" session need- to be 
experienced. Once experienced by an open 
minded lecturer, that experience will be- 
come motivation for more material prepa- 
ration. 

Australia's software crossroads 

A well known phenomenon is the loss of 
qualified staff to overseas countries. The 
emergence of significant user friendly 
Computer Assisted Instruction by Austra- 
lian authors may lure Australians seeking 
recognition to countries willing to pay for 
their expertise. 

Package success 

The "Q" instruction package developed to 
meet the needs of TAPE has suffered the 
relative ignomony reserved for poets in 
their own land. British Publishing Houses 
have taken interest in this software pro- 
duced in Adelaide, and are seeking to 
market the product in the large U.S. mar- 
ket. 
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The modern Personal Computer and soft- 
ware packages have matured. Mature 
Packages which are simple to learn will 
succeed. "Q" is one such package. It stands 
well without graphics on a monochrome 
display, it performs better when enhanced 
with full colour graphics, accepting colour 
frames. 

"Q" has the ability to interact with other 
computer packages providing tutoring 
capability with direct links to another 
computer program . It is suitable for use in 
the computer arena while compatibility 
with Videodisk rates the package with 
todays leaders providing the very best 
Video quality graphics with simple Word- 
star generated text 

Management solution for friendly 
software 

like all successful computing installa- 
tions, Computer Assisted Instruction 
Management Assessment is simply an- 
other one which will stand or fail on the 
support it receives from senior staff. 

Conclusion 

Educators today, have may choose to be 
part of the change, but tomorrow there will 
not be a choice. Students directing their 
own learning will demand packages they 
can take home, packages which they can 
use to tutor their children, and packages 
which can be easily modified. 
Wordprocessing, the tool we use daily, will 
be the prime tool for preparation of tutorial 
material. The "Q" Instruction Package 
succeeds in making minimal assumptionof 
computer familiarity. Its success will be 
recognised in Australia or overseas. It is to 
be hoped that the phrase "A man is not 
without honor but within hisown country" 
will not come to apply to the developers of 
the "Q" instruction padcage. 



Interactive videodisc in the teaching of 
Orthopaedics in Phytotherapy. 



Allan Christie 

School of Physiotherapy 

South Australian Institute of Technology 



The use of an innovative educational me- 
dium such as the interactive videodisc was 
seen as a way of maximizing student learn- 
ing by using its attributes of excellent visual 
images, interactivity (active student learn- 
ing), feedback, quick response time, and 
the potential for student-directed and stu- 
dent-paced learning. A videodisc contain- 
ing 1981 slides and approximately 34 min- 
utes of video was produced in PAL format 
and the authoring language PC/Pilot was 
used for programming. Evaluation of the 
effectiveness of interactive videodisc as a 
learning medium will be conducted using 
the illuminative method rather than the 
more traditional outcome-oriented or 
comparative model. 

The teaching of the subject "acute ortho- 
paedics" is performed over two years of the 
undergraduate physiotherapy course at 
SAn\ Firstly, there is the expansive but 
necessary theory input in second year with 
little practical supplement and, secondly, 
there is the relatively large practical input 
in fourth year with little chance to revise the 
orthopaedic theory except from notes 
taken in second year. 

Student-paced and student-directed learn- 
ing was seen as a way of addressing these 
problems, however, a conventional form of 
self-paced study using student guides/ 
notes was not considered suitable as much 
of the information to be learnt was of a 
visual nature* Also feedback and interac- 
tivity were considered to be important as 
there appears to be general acceptance in 
the literature that learning is an active, 
9 
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rather than a passive, process (Cooeland, 
1981; Young, 1984; Pemberton et ai., 1985; 
Clark & Sandford, 1986). The interactive 
videodisc (IVD) system (combining the 
microcomputer with a videodisc player) 
was seen as an ideal medium as it presents 
a flexible image-rich learning environment 
which has the potential to be both student- 
paced and student-directed. Second year 
students could use the system to learn new 
material and at the same time it would be 
available to fourth year students to supple- 
ment their practical experience. 

In accord with Baker & Ziviani (1986) the 
use of an information transfer system such 
as IVD was also considered beneficial for 
the following reasons; 

• having subjects available for student 
observation is desirable though not 
always possible. 

• even when they can be observed, re- 
peated performance for the benefit of 
student analysis cannot be guaranteed. 

• the financial and time costs of organiz- 
ing such sessions are becoming increas- 
ingly prohibitive. 

• theinstructionisconsistently reproduc- 
ible. 

Learning Theories 

Learning theories have their baste in two 
principal schools of psychology - ^ugnitive 
and behaviourist. Bruner (1966) and Sten- 
house (1975) are leaders in the field of cog- 
nitive psychology which emphasizes the 
importance of the process of learning and 
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learning by discovery. Behaviourist psy- 
chology was popularized by American 
psychologists, Tyler (1949) and Skinner 
(1958). The hallmarks of this approach are 
behavioural/performance objectives, out- 
comes of learning and the stimulus-re- 
sponse model. Not surprisingly, the be- 
haviourist approach to learningformed the 
basis of early programmed instruction 
methods and subsequent computer as- 
sisted learning (CAL) initiatives. Until the 
mid-1970s much of the evaluation of CAL 
was also based on this behaviourist ap- 
proach with the traditional hypothetico- 
deductive model (in the guise of compara- 
tive studies) being used. There was, how- 
ever, growing dissatisfaction with this 
approach to evaluation which sought to 
analyse a complex situation such as the 
learning milieu in terms of outcome only. 
A few of the pitfalls of this approach in- 
clude; 

a. not recognizing features salient to the 
success or acceptability of the project 
because the information to look for has 
already been decided at the beginning 
of the project in a way which excludes 
"unsought" information. 

b. the assumption that if an ''experimen- 
tal" model is adopted that salient vari- 
ables can be identified and controlled 
for; an assumption unlikely to be met in 
a real and complex situation. 

Parlett and Hamilton (1977) highlighted 
these and other shortcomings of the "objec- 
tives" approach to evaluation in a book 
"Beyond the numbers game" and pro- 
posed a more comprehensive and descrip- 
tive form of evaluation which they called 
the illuminative method (as light was 
thrown onto the topic under considera- 
tion). Following on from this approach 
Jones and O'Shea (1981) indicated that the 
traditional question always posed when 
considering CAL; "How effective?", 
should be replaced by "How is the project 
perceived from the client's point of view - 



and what are its salient and critical features 
which make its acceptability and success 
more or lesslikely?". In this way one would 
be looking at both content and quality of 
the learning experience as well as the con- 
text in which learning occurs. Methods 
used to obtain information using the illu- 
minative approach include; 

• observation 

• questionnaire (both open and closed 
questions) 

• interview 

• written appraisal 

In ter active Videodisc 

According to Sweeney (1985/p. 90) the fol- 
lowing goals should be set and fulfilled 
when developing a videodisc; 

1 . utilize all optical videodisc functions in 
a variety of ways. 

2. cohesive topical program even though 
it contains individual modules. 

3. human quality demonstrated as well as 
archival information storage. 

4. high repeatability value - one or two 
viewings should not exhaust informa- 
tion available in a sequence. 

5. should be amenable for setting up pro- 
grams for learners interested in varied 
(butrelated)topicsand provide accessi- 
bility to different levels of information 
or expertise. 

Interestingly, the author independently 
developed the Orthopaedic interactive 
videodisc with similar goals in mind. Put 
simply, the aim is to use the pedagogical 
potential of interactive videodisc to its full- 
est. 

IVD Workstation 

The IVD workstation used at S AIT consists 
of a microcomputer, mouse, videodisc 
player, and monitor. The instructional 
design of the videodisc material required a 
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single screen presentation so that the 
broadcast quality video pictures couid be 
overlaid with computer generated text and 
colour graphics. 

Two different single screen configurations 
have been used by the author; 

1. Computer video mixing - video mixing 
card (Eg., Videologic MIC-2000I + EGA) 
combined with a fast-blanking monitor 
(Eg.,SonyKX-14CPl). 

Pros 

• MIC-2000 card initializes the vide- 
odisc player and so the same set of 
commands controls all of the popu- 
lar videodisc players thus simplify- 
ing programming. 

• MIC-2000 card can perform soft- 
editing, i.e., real-time editing of the 
video, audio and computer signals. 

• the single card satisfies both major 
colour television standards; PAL 
andNTSC. 

Cons 

• expensive - MIC-2000I + EGA 
(Quadram Quad+ rec.) ~A$3400 

• recommended monitors such as the 
Sony KX-14CP1 do not support 
EGA. 

2. Monitor video mixing -e.g., Mitsubishi 
monitor EUM-1471A combined with 
EGA card. 

Pros 

• monitor supportsCGA/EGA/PGC. 

• PAL video can be overlaid with 
computer text and graphics via the 
RGB analogue unit. 

• reasonable cost - monitor A$1600 + 
EGA. 

Cons 

• programming is more difficult and 
so there is a time/productivity cost. 

The CAL lessons were developed using the 
PC/ Pilot authoring language (see Appen- 
dix A). 
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Economic. Evaluation 
Materials 

• dubbing high band tape to 
1" C format tape and to 
U-matic low band time code 
tapes (for off-line editing) 
(8 hours @ $160/hour) A$l,280 



• use of 1" editing facility 

(31 hours @ $150/hour) 4,650 

• 1" premaster tape 144.60 

• slide production 908.64 

• high band tapes (17® $25 
-SonyKCS-20BRK) 425 

• broadcast video unit hire 
(5days@$30/day) 150 

• royalties for music 80 

• single-sided videodisc 

pressing charges (Sony) 4,840 

• 10 videodiscs® $57.85 578.50 



A$13,056.74 

Filming and off-line editing were per- 
formed by the audio-visual services unit of 
the Institute. 

Man-hours 

• scripting 50 hours 

• editing videotape 60 hours 

• layout of material on disc 40 hours 

• cataloguing slides 60 hours 

• programming 200 hours 



(approx) 410 hours 

This time (approx. 410 hours) was spread 
over a period of 12 months but certainly 
these figures indicate that a videodisc must 
be produced by a team (ideally consisting 
of a content expert, instructional designer, 
programmer and video producer). 

Hardware costs continue j decrease but 
videodiscs and associated software are 
labour-intensive products, so there is not 
likely to be a decrease hi their cost in pro- 
portion to the hardware. 
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Pedagogical Evaluation 

As indicated in the introduction, innova- 
tive educational technologies have been 
inappropriately and inadequately evalu- 
ated in the past due to predominance of 
"scientific" comparative studies. Conse- 
quently, the author plans to evaluate this 
interactive videodisc using, what could be 
termed a holistic approach, and producing 
a multifaceted description of its use in the 
learning milieu. 

Evaluation tools will include; 

Content written appraisals 

- physiotherapists 

- orthopaedic surgeons 
pretest/posttest - second year 
undergraduates 

Process attitudes/opinions 

- questionnaire 

- interview 
observation 
computer program 

- in/out time 

- audit trail through program 

Appendix A 

An example of ihe ease of programming 
using the PC/Pilot authoring language is 
the following segment of code used to 
control a videodisc player connected to a 
microcomputer with a MIC-2000 card and 
then dispby a computer generated rnenr. 

r: — open MIC device driver 
fx:mic 

r: — carriage return is used with each 

command to videodisc 
r:-- player so it is defined as a string 

for ease of programming 
d:cr$U) 
c:cr$=chr (13) 

r: videodisc command 

r: — initialise videodisc player 
fo:0,"init"' !cr$ 

r: videodisc command 

r: — search for frame 5 and stop videodisc 
player 



fo:0, "still 5"! !cr$ 



videodisc command 



r: — turn video on 
fo:0, "video on"!!cr$ 

r: videodisc command 

r : — turn aud io on 
fo:0, "audio on" ! 'cr$ 

r: videodisc command 

r: — play videodisc player from frame 5 

to frame 1200 
fo:0,"play ,1200"! !cr$ 

r: videodisc command 

r: — wait until end of play 
fo:0, "wait endplay" ! !cr$ 

r: videodisc command 

r: — turn video off 
fo:0, "video off"! !cr$ 

r: — main orthopaedic menu 1 

j:@P 

*menu 

ts:m0;e7;vl, 38, I,23;e0;f6 
t : 

: MAIN MENU 1 



ts:fl4 
t : 

ts:f4 
t : 



ORTHOPAEDICS 



1. Introduction 



2. Fractures 



3. Fixation 



4. Main Menu 2 



5. Main Menu 3 



6. Exit 



ts:f6 
t: 



: PRESS #7.>#6 TO SELECT 

: "~ESS K7SPACE BAR#6 TO CHOOSE ANOTHER 

e : 

p: 

u :menu 

ts:f2;gl0, 7;al. Introduction 
*nol c:x=key (0) 

ts(x=13 »x=4 9) :g3,21; f7;ALoading ; 

1 <x=13 !x=49) : intro 
j (x>49fix<54) :number 
j <x=54) :quit 
j <x<>32) :nol 

ts : f4;gl0,,7;al. Introduction 
ts:f2;gl0,9;a2. Fractures 
*no2 c:x=key(0) 

ts(x=13 !x=50) :g3,21;f7;ALoading ; 

l(x-13!x=50) :frac 
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Main Menu 2 
Main Menu 3 



j(x>48tx<54) :number 
j(x«54) :quit 
j(x<>32) :no2 

ts:f4;gl0 / 9;a2. Fractures 
ts:f2;gl0, ll;a3. Fixation 
*no3 c:x=key(0) 

ts(x»13!x«51) :g3,21;f7;ALoading. 
l(x=13L;«5i) rfixat 
j(x>48sx<54) mumber 
j(x»54) :quit 
j(x<>32) :no3 

ts:f4;gl0, ll;a3. Fixation 
ts:f2;gl0, 13;a4. Mam Menu 2 
*no4 c:x«key(0) 

ts(x=13!x=52) :g3,21;f7;ALoading. 
l(x=13!x=52) :menu2 
j (x>48&x<54) .-number 
j (x=54) :quit 
j(x<>32) : n o4 
ts:f4;gl0, 13;a4. 
ts:f2;gl0,15;a5. 
*no5 c:x*key(0) 

ts(x«13.!x=53) :g3 # 21;f7;ALoading. 
l(x=13!x-53) :menu3 
j(x>48fix<54) mumber 
j(x=54) :quit 
j(x<>32) :no5 

ts:f4;gl0, 15;a5. Main Menu 3 
ts:f2;gl0, 17;aE. Exit 
*no6 c:x=key(0) 
j(x>48fix<54) mumber 
j(x=13!x=54) :quit 
j(x<>32) :no6 



*quit 

ts(x=13!x=*54) :f7;b0;m2 
ec: 

ts:f4;gl0,17;a£. Exit 
ts:f2;gl0, 7;al. Introduction 
j:nol 

*number 

ts(x>48&x<54) :g3,21;f7;aLoadmg. 

1 (x=49) :intro 

l(x«50) rfrac 

1 (x»5l) :fixat 

1 (x«52) :menu2 

1 (x=53) :menu3 



*no2a 
u :menu 

ts:f4;gl0,7;al. 

ts:f2;gl0, 9;a2. 

j:no2 

*no3a 

u :menu 

ts:f4;gl0,9;a2. 

-s:f2;gx0 / ll;a3. 

j :no3 

*no4a 

u :menu 

ts:f4;gl0,ll;a3. 



Introduction 
Fractures 



Fractures 
Fixat- ion 



Fixation 



ts:f2;gl0, 13;a4. Main Menu 2 
j :no4 
*no5a 
u :menu 

ts:f4;gl0, 13;a4. Main Menu 2 

ts:f2;gl0, 15;a5. Main Menu 3 

j :no5 

*no6a 

u:menu 

ts:f4;gl0, 15;a5. Mam Menu 3 
ts:f2;glO,17;aE. Exit 
j :no6 
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Using computers in education intelligently: 

What happens when computers are removed from the 
classroom? 

Kelvin W. Duncan 

Department of Zoology 

University of Canterbury, New Zealand 



This is a case study of a first-year university 
course in whk_. computers w~re used ex- 
tensively in the teaching and administra- 
tion of the course until, following a change 
in staff a few years ago, the computing 
component was removed from most of the 
course work. This paper describes what 
happened following this change to more 
traditional ways of teaching. 

The intelligent use of computers in class- 
rooms is possible provided the following 
desiderata are observed: They should be 
used only when appropriate. They shou' 
be cost-effective, time-effective and peda 
gogically effective. The teaching programs 
should be comprehensible, relevant and 
non-trivial with a good student-machine 
interface. Costly establishment overheads 
should be minimized. Future hardware 
incompatibilities should be avoided. 

There is a general recognition that the 
computer is here to stay in tertiary educa 
tion and that it can make a great contribu- 
tion to teaching effectiveness and attrac- 
tiveness. It can facilitate interaction with 
the subject matter, generating a real in- 
volvement and deeper understanding. But 
to a teacher considering introducing CAL 
techniques the difficulties in establishing a 
CAL programme are very large, as are the 
co&ts. Teaching with computers requires 
special skills, and the time required to 
develop and trial CAL modules can be very 
great. Costs, for equipment software and 
assistance, can be so high that they may 
pose another large hurdle to the develop- 
ment of CAL courseware. 
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These costs in time and money are recog- 
nized well enough and are a reason often 
advanced as a reason for not using CAL 
techniques in the class room. But what is 
not generally appreciated is that rejecting 
CAL techniques also involves a cost. While 
academics are accustomed to change in 
their research fields, it is surprisingly diffi- 
cult to convince them that a static approach 
to teaching is not a no-cost option. Lost 
opportunities for change in search of excel- 
lence and more effective teaching can be 
damaging and thus much more costly in 
the longer term than if CAL programmes 
had been instituted. 

Rather than consider the difficulties of es- 
tablishing computer-based teachingmeth- 
ods in a course, I wish to examine the rather 
novel question of what happens if the new 
technology is abandoned and traditional 
techniques reverted to as a matter of delib- 
erate policy. Consideration of the effects of 
this may give insights into such questions 
as the following: Is it always intelligent not 
to use the new technology? Should we 
always rely on tried- and-true traditional 
methods? Is there a cost if we do take the 
conservative approach? Is use of only a 
part of the new technology worse than not 
using it at all? In short, is it intelligent not 
to use the new technology? 

It is often not appreciated that the nature of 
tertiary teaching has changed fundamen- 
tally in recent times, so that cour jS which 
rely solely on traditional teaching tech- 
niquescan fall into the following traps even 
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though they may have been successful in 
the pari: 

a. The course content (subject matter) may 
appear old-fashioned and therefore 
non-relevant. This is especially so if no 
modern techniques or aids are em- 
ployed at all. To a generation of stu- 
dents brought up in an environment at 
home and at school or university in 
which the new technology - in the form 
of television, audio, computers, arcade 
games and the like - makes up a vital 
part of daily life, chalk and talk can 
seem very dull. Those courses which 
reject the new technology and employ 
only traditional 7 spray and pray 7 teach- 
ing techniques may loose elective en- 
rollments with serious consequences 
for funding if this is based on en- 
rollments. 

b. The teachers in courses relying on tradi- 
tional teaching techniques may appear 
'old fashioned 7 in their approach and 
ou t of touch, leading to an impression of 
mediocrity in their discipline. 

c. Course revisions and updates can be 
more difficult to do. On the other hand, 
computer-based courseware is easily 
edited and updated so the days of tatty 
notes resulting from 'cut-and-paste 7 
editing can be left behind. 

d. The teachers using traditional methods 
in a course irtay find it difficult to take 
advantage of new developments or 
teaching aids because they are locked in 
to a conservative form of teaching. Over 
the years, they might find that the even- 
tual expenditure of bme and effort in 
attempts to improve and update their 
courses may be far greater than if CAL 
courseware had been developed in the 
first place. 

f. Demands on teaching assistants (mark- 
ers, tutors and demonstrators) may 
become too costly in traditional courses. 



This is especially important now that 
expenditure on tertiary education is 
being closely scrutinized. 

g. Skill development and learning of con- 
tent may be less, often much less, than 
that attainable in a CAL course. 

h. In courses taught in a traditional man- 
ner there may develop a strong ten- 
dency to non-participatory, passive 
learning leading to a tendency toward 
surface, or shallow learning. On the 
other hand, CAL can encourage partici- 
patory learning with the development 
of deep understanding. Furthermore, 
learning in such courses can be more 
thorough, faster, more enjoyable, and 
with more opportunities for remedial 
instruction than in courses taught in 
traditional ways. 

Let us now examine the fate of one course 
which fell into these pitfalls because of a 
reluctance of the teaching staff to become 
involved with computers and computing. 

BIOLIOX - A subject which went 
away from CAL 

In the early 1970 7 s elementary biology 
teaching at Canterbury University, Christ- 
church, New Zealand, was rationalized 
and reorganized into more logical units. 
Thus BIOLIOX, amongst other biology 
courses, was begun. It was to present 
material which had been taught reasonably 
successfully earlier in a different course 
format. However, the reorganization 
caused the staff to think about their effec- 
tiveness, and so new computer-based 
methods were tried. 

Early on in the history of the course various 
computer simulations were developed. 
These were extended and improved as 
experience accumulated. Later, the learn- 
ing was modularised, and computer-based 
tests and practice programs introduced. 
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The students were allowed to progress 
more-or-less at their ow i pace. When they 
felt competent, they sat a computerized test 
of the material covered in that module. The 
computer program devised the questions 
from an approved pool devised by the 
teachers; it marked the answers, kept the 
student records and made recommenda- 
tions to each student regarding remedial 
work for areas of weakness. Using a mas- 
tery model of teaching, failing students had 
opportunity to re-sit until they achieved a 
sufficient standard to advance to the next 
module. 

Thus at the end of 1978 the course made 
heavy use of computers for the following 
purposes: 

1. Simulation 

a. of biological phenomena impossible 
to demonstrate otherwise; 

b. of practical work done by students. 
The computer simulations acted as 
checks on the students' progress and 
comprehension of students; 

2. Analysis 

C the results of student experiments 
using statistical methods. 

3. Practice 

Practice programs and quizzes were 
available for non-compulsory review. 

4. Testing 

Using marksense cards, a system of 
quizzes, which terminated and tested a 
sequence of instructional modules, was 
instituted. At the end of each unit of 
work the student sat the test. Retests 
were available. Marking and compre- 
hensive analysis was done by com- 
puter; the machine producing sugges- 
tions for remedial work for each student 
if necessary. 

5. Administration 

Intermarker performance was moni- 
tored and compensated for if necessary. 

O 
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All the ordinary administrative tasks 
were performed by the computers. 

This was all before micros made it much 
easier to carry out such work - these appli- 
cations were done in the 1970's on main- 
frames, and were largely carried out in 
batch mode to minimize cost. 

The teachers of BIOL10X were enthusiastic 
and worked well as a team. New ap- 
proaches were encouraged and no compro- 
mise was made to dilute the subject matter. 
Difficult topics were attempt 1, and usu- 
ally conquered. The students were encour- 
aged to go beyond the confines of their 
course work and to work on their own to 
greater breadth and depth. 

The course was very popular as was shown 
by replies to independent questionnaires 
administered by the student body. These 
surveys indicated that most studentsfound 
the course to be very worthwhile and inter- 
esting, with a well-structured and logical 
theory and practical component. 

The popularity of the course was also indi- 
cated by the greater proportion of the class 
taking the coui se on a voluntary basis than 
in any other biology course. Enrollments in 
some other biology courses were nearly as 
high, or even higher, but their numbers 
were boosted by prerequisites making 
enrollments compulsory. The high num- 
ber of elective enrollments in BIOL10X 
were a matter of pride to the teaching staff. 

A change of scene 

Departmental policy was for staff to be 
rotated around courses at intervals of some 
years to "keep them from going staie". In 
due course the staff of BIOL10X were re- 
placed, in spite of their considerable oppo- 
sition and reluctance. 

The new staff were far less keen on comput- 
ers. A few simulations were retained, but 
much less emphusis was given to the heavy 
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involvement of computing in the course 
work. So it proved impossible to maintain 
'mastery 7 type learning where each indi- 
vidual maintained his/her own rate of 
progress, and their attainment and prog- 
ress was closely monitored and remedial 
work set in place immediately. 

The long-termed consequences for this 
course were disastrous. From a vibrant, 
well-regarded course it became voted "the 
worse course at the University of Canter- 
bury" within a few years of the change 
over. This had a terrible effect on staff 
morale. Now the course is notable for the 
lack of cooperation between the staff, the 
lack of staff enthusiasm and involvement. 
Students are bored and merely do the 
course because they are forced to because 
of prerequisite demands. Elective en- 
rollments have disappeared. 

Table 1, which gives the class sizes in 
BIOL10X since establishment, shows dra- 
matically the decline in numbers of elective 
students in the years following removal of 
computers. There are, of course, other 
explanations for this decline; of which 
three spring to mind: (1) the subject matter 
may have become less popular or unfash- 
ionable; (2) there may have been changes in 
the structure of university enrollments 
such that the size of the elective pool be- 
came progressively smaller; or (3) the new 
team of teachers were not as good as the 
old. 

There is no evidence for any change in the 
popularity of the corrse. Very similar 
courses at other universities have shown 
steady growth - not the dramatic decline 
experienced at Canterbury. It is significant 
that CAL plays an ever-increasing role in 
the similar courses at other universities. 

Nor is there any solid evidence for the 
second explanation - if anything, students 
can take more elective courses now than in 
the late 1970's since many prerequisites 
have been relaxed. 



The third proposition, that the new teach- 
ers were not as good as the original team, is 
debatable since the previous teachers were, 
in the opinions of their colleagues, rather 
bad! One was notorious for reading his 
lectures from a disjointed seriesof texts - he 
never wrote lecture notes and merely pre- 
sented a series of quotations which were 
often rot in a very logical order. The stu- 
dents, too, were often critical in their ques- 
tionnaire replies, of the lecturing style of 
the original teachers, even when they sang 
the praises of the course as a whole. 

The most probable explanation is that the 
removal of computers caused a variety of 
things to happen which resulted in the 
declineinstudentenrolment. Firstly, much 
of the old teaching programme had to be 
discarded or drastically simplified to fit the 
constraints of a lecture-based course. This 
resulted in boredom and a lack of challenge 
amongst 4?oth students and teachers. 
Learning became passive and non-partici- 
patory which increased student dissatis- 
faction. The previous close monitoring of 
studentprogressandprovision of feedback 
had to be given up, which resulted in in- 
creased student anxiety about their prog- 
ress and a focussing on .narks rather than 
mastery of the subject. The students no 
longer felt as though they could conquer 
the course incrementally, but had to master 
it all in one step for finals examination. 
This, too, increased student disquiet. And 
they no longer felt that the course had a 
discovery learning component. Instead, 
they had to work at a pedestrian pace in 
large classes with minimal staff help or 
enthusiasm on material which seemed dull 
and devoid of challenge. The staff also felt 
the changes. Froma closely planned course 
it became a set of individual teaching ef- 
forts, uncoordinated to the whole. The 'my 
patch' syndrome developed, and a lack of 
cooperation affected every teacher. 

Further evidence as to what went wrong, 
here are ? selection of quotations from the 
course reviews conducted by the students 
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and based on the replies to questionnaires. 

1978 (the first year of these independent 
course assessments) "An interesting 
course. Well structured and logical prac- 
tical and lectures." 



TABLE 1. Oasssizesin BlOLlOXin different years. 
At the end of the 1978 academic year computers were 
removed from the classrooms. The column headed 
enforced enrolment gives the estimated number of 
students who had to take the course for prerequisite 
reasons. 



1980 "Depressing. Course made up of 
dregs of all other Bio. courses. Poorly 
structured. Labs confusing. Pathetic." 

1982 "This course should be avoided at 
all costs. It is incredibly boring. Labs 
badly organized, dull and irrelevant. 
Dedication is required to complete. Only 
bright sp t is that assessment load is 
light, th . is if you can fight back the 
boredom long enough to do some work." 

1984 'This is the worst course at the 
University of Canterbury. Avoid at all 
costs." 

The course enrolment is protected from 
becoming zero by enforced enrolment on 
account of the prerequisite requirements of 
advanced second and third year courses. If 
a student wishes to advance to these second 
and third year courses he must take 
BIOL10X. We can estimate this enforced 
enrolment by adding the number of stu- 
dents in advanced courses with BIOL10X 
as a prerequisite plus first vear failures and 
drop-outs. The figures for this are given in 
the second last column of Table 1. By 
calculating the percentage of elective en- 
rollments (given in the last column of Table 
1 ) it can be seen the voluntary enrolment in 
the course fell rapidly as the course became 
unpopular until today there is no evidence 
for any elective (voluntary) enrolment at 
all. 

The change had even more serious conse- 
quences for other biology courses. 
BIOL10X was a flagship course where 
experimental methods of instruction and 
teaching were v/elcome and enthusiasti- 
cally trialled. After a successful trial in this 
course many very valuable innovations 



Year 


No of 
Students 


Enforced 
Enrolment 


Non -Compulsory 
Enrolment (%) 


1975 


245 


98 


60.0 


1976 


252 


101 


59.9 


1977 


260 


103 


60.4 


1978 


248 


100 


59.6 


(Computers were removed at the end of 1978) 


1979 


270 


111 


5? 8 


1980 


232 


113 


51.3 


1981 


227 


126 


44.5 


1982 


218 


115 


47.2 


1983 


176 


109 


38.1 


1984 


179 


110 


38.5 


1985 


210 


135 


35.7 


1986 


125 


125 


0.0 


1987 


139 


139* 


0.0* 



* Estimated 

were adopted in other courses. Following 
the changes, the flagship function disap- 
peared. Finally, the enthusiasm of the old, 
and now disbanded team for CAL tech- 
niques was dissipated. They had been 
taken against their will away from a course 
in which they had close personal involve- 
ment, and placed in new courses with new 
colleagues indifferent to, or even positively 
hostile to, computer-based teaching. 
Somewhat naturally, the old enthusiasts 
ran out of steam. Faced with new, hostile 
environments it proved difficult to main- 
tain enthusiasm for the new style of teach- 
ing with its great establishment overheads. 
As a consequence, we now lag behind in 
the CAL area, not merely in the particular 
subject matter taught in BIOL10X, but in 
most other aspects of biology as well. 

It is trite to say that computers are here to 
stay and that they have a vital and neces- 
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sary role to play in teaching. But the con- 
verse of this is not trite, and is often not 
recognized: to not use computers may 
seem like the easy option, but it is not a "no 
cost" one. 



Kelvin Duncan is Senior Lecturer in 
Zoology, he has been using comput- 
ers in teaching since 1967. He has 
worked with a variety of -UK and 
USA groups interested in CAL, in- 
cluding Computers in the Under- 
graduate Curriculum, University of 
London, University of Lancaster, 
and others. Main interest area lies in 
the use of computers in simulation 
and analysis in biology practical 
classes, but he has also worked with 
primary and mentally handicapped 
children. Beside major professional 
research work on ecological physi- 
ology of terrestrial invertebrates, he 
has been working on ways of mak- 
ing the computer more accessible to 
intellectually handicapped children 
in the belief that computers have a 
major role to play in their education. 
To this end he works with a number 
of teacher groups on a voluntary 
basis to develop courseware for 
schc Is. 
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Software Simulation of 
Microprocessor Hardware 



David T Edwards and Robert G Craig , 
School of Engineering 

Darling Downs Institute of Advanced Education 



This paper reports on a TurboPascal lan- 
guage simulation program running on 
personal computers being developed to 
aid the teaching of microprocessor funda- 
mentals to both internal and external un- 
dergraduate Electrical Engineering stu- 
dents of the Darling Downs Institute of 
Advanced Education. Traditional teach- 
ing has used a Motorola MC6802 based 
single board development system (the D3 
or D5;, where program debugging is 
achieved by halting the program and se- 
quentially examining the CPU registers. 
The enhanced display capabilities of this 
simulation package allow students to si- 
multaneously view memory and register 
contents as a machine language program 
executes. Preliminary trials with internal 
students indicate a significant speed up 
factor in the learning process. 



The D.D.LA.E. School of Engineering has 
for a number of years been teaching micro- 
processor fundamentals to students en- 
rolled externally in the Associate Diploma 
in Electrical Engineering. To develop 
hands on skills, these students have at- 
tended an on campus residential schoo.. 
They have then carried out a programming 
assignment using a microprocessor devel- 
opment "kit in a suitcase" : the D3 kit based 
en the Motorola MC6802 microprocessor. 
The kit was collected at residential school 
and "passed around" among a group of 
students to complete their assignment(s). 
Internal associate diploma and degree stu- 
dents use a similar microprocessor devel- 
opment system, the D5 board, which is a 



later but near identical version of the D3 
board. 

One of the authors (Edwards) has devel- 
oped a software simulator for this Motorola 
D3 (and D5) kit. This program, written in 
the TurboPascal language, is intended for 
running on an IBM-PC or equivalent. 
Access to such desk top computers is made 
available to students in the D,D.I.A.E. ex- 
ternal study centres located throughout 
Queensland. 

Compared to the original hardware the 
simulator has a number of significant en- 
hancements designed to expedite the 
teaching/learning process. An early ver- 
sion of the simulator was used on a trial 
basis in first semester 1 987 with an internal 
associate diploma class. In second semes- 
ter 1987 the simulator is being used with an 
external associate diploma group and an 
internal degree group. 

This paper will briefly describe the existing 
hardware system. The simulator software 
and the results of the first semester trials 
will then be discussed. 

Objectives of developing the 6802 
Simulator 

The principal objectives of introducing the 
6802 simulator were twofold. 

1. To provide the same learning opportd 
nities for external students as exist for 
internal students. 
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As internal students have class access to the 
hardware for approximately 22 hours, and 
a large amount of "out-of-hours" access, 
spread over the whole semester, external 
students should have a similar amount of 
"hands-on" access. The present "pass-the- 
kit" situation for external students limits 
their hardware access to about 10 hours 
"driving instructions" at residential school 
plus one intense burst when they have a kit 
at home. To provide each external student 
with a kit of "their own is prohibitively 
expensive at a component cost of approxi- 
mately $1000 per kit plus many hours of 
technician time both to build up the kits 
into a self-contained entity and to service 
them when faults occur. 

2. To improve the laboratory support for 
the teaching of microprocessor funda- 
mentals. 

Students find difficulty in coming to grips 
with many of the essentials of microproces- 
sor programming. Many find concepts 
such as flags, program counter, stack 
pointer and indexing quite difficult to 
grasp. Displaying these and other features 
simultaneously should enhance the stu- 
dents' learning. 

The existing hardware has no conveniently 
accessible off-line program storage so stu- 
dents must either key in their programs 
each time by hand or down-load from one 
of the Institute's main-frame computers 
(an option not available to external stu- 
dents^ . Easy access to off-line program stor- 
age is a needed feature. 

Description of existing hardware 

The D3 kit u a combination of hardware 
and firmware designed to assist with the 
understanding of the Motorola MC6802 
microprocessor and commonly associated 
components. The system as configured by 
the School of Engineering has the following 
facilities ;- 



• A ROM monitor which performs house- 
keeping and provides the user with a 
number of utility routines. 

• 256 bytes of RAM for user program and 
data storage. 

• A keypad for inputing either hexadeci- 
mal code or invoking some of the moni- 
tor routines. 

• An array of 7-segment digits to display 
both user and monitor information. 

• A tape input/ output port for magnetic 
storage. 

• An RS232 interface for serial communi- 
cations ( ACIA ). 

• A programmable interface for parallel 
communications ( PIA ). 

• A reset button which clears the CPU 
registers and returns control to the sys- 
tem monitor. 

The above configuration permits the stu- 
dents to progress from the design of simple 
data manipulation programs to the design 
and implementation of more complex real- 
time algorithms such as digital filters and 
interrupt driven feedback control. Unbuf- 
fered access is available to the system ad- 
dress, control and data busesenabling such 
operations as DMA, or the accessing of the 
digital output of an A/D converter directly 
onto the system bus, as alternative input/ 
output mechanisms. 

Specification of the D3 simulator 

1. The simulator should have the same 
display as the actual D3 kit. 

This is a 6 digit 7-segment hexadecimal 
display with the first 4 digits for display of 
the address of a memory location and the 
last two digits for display of the contents of 
that memory location, (see figure 1). 

2. The keyboard input to the simulator 
should mimic the keyboard input to the 
D3 kit. The D3 keypad has 25 keys 
arranged in a 5 by 5 matrix (see figure 2). 
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Figure 1: Data display 
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Figure 2: D3 Keypad 

The 16 keys for inputting hexadecimal 
digits (0. . .9,A. . .F), for address or memory 
contents should be implemented by the 
corresponding keys on the simulator mi- 
crocomputer keyboard. The remaining 9 
keys perform housekeeping by accessing 
the Motorola monitor. Since these keys 
have a multi-character label, a suitable 
singlekeyboard character would have to be 
found to be used on the simulator. The D3 
function keys have the following actions: 

Key Function 

RS reset the CPU registers and invoke 
the monitor 'prompf routine 
select alternative key function 
clear alternative key function 
tape store/load 

step a machine language program 
one instruction; or insert a break- 
point 

allow editing of tne memory loca- 
tion the address of which has been 
entered; or allow access to the previ- 



FS 
FC 
P/L 
T/B 



M 



EX 



RD 
GO 



ous memory location when editing 
invoke 'prompf without resetting 
the CPU registers; or cease the exe- 
cution of a running program 
CPU register display 
run a program; or allow access to 
next memory location when editing 



3. All needed Motorola 6802 opcodes 
should be simulated. 

( The only opcodes not implemented are 
those that refer to interrupts :- RTI , WAI , 
SWI.) 

4. Sufficient of the Motorola D3 monitor 
routines as is necessary for students to 
complete their assignments should be 
implemented. 

Many of the monitor routines are effec- 
tively implemented through the keyboard 
keys. In addition the following monitor 
routines were required: 

GET waits for a key to be pressed 

and then loads that key's 
"value" into accumulator A. 

DYSCOD takes hexadecimal values 
stored in a buffer (HEXBUF) 
and produces a 7-segment 
display code for each digit in 
the buffer (DISBUF). 

PUT displays on the output dis- 

play the 7-segment displays 
stored in (DISBUF). 

PROMPT returns to the prompt and al- 
lows further monitor instruc- 
tions. (The last action at the 
end of a machine language 
program). 

5. Compared to the D3 hardware the 
simulator should have enhanced dis- 
play characteristics. The standard dis- 
play of numeric information should be 
in hexadecimal. The display on the 
simulator screen should include, in 
addition to the standard display of the 
hardware: 



ERLC 



Using Computers Intelligently 

• The contents of all registers. The con- 
tents of the condition code (flag) register 
should be displayed both in hexadeci- 
mal and in binary. The binary display 
makes it easier to see which of the 6 flags 
have been set. 

• The current position of the program 
counter (PC) and the stack pointer (SP). 

• The contents of the page (256 bytes) of 
user memory. This display should dis- 
tinguish between values that have been 
set (or defined) by the user as program 
or data and the "random" values that 
the memory locations have either from 
previous use or switch-on. (This option 
was chosen to unclutter the display. ) 

• Any changes to SP, PC, register or 
memory contents caused by an instruc- 
tion being executed should be high- 
lighted. 

6. There should be a capability to load 
machine language programs (memory 
contents) from disk and also to save to 
disk. 

7. On-line help should be available. 

For external students all the information 
required to use the simulator should be 
available on the single floppy disk. 

8. All functions of the simulator should be 
"menu-driven" with single key stroke 
choices at each stage. 

The simulator program should be "crash- 
proof" with the user protected again*,* 
making mistakes that could cause prob- 
lems. 

Description of the simulator 
program 

The program has been developed using the 
TurboPascal language. This was used for a 
number of reasons including: 

• The friendly development environ- 
ment. 

O 
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• TurboPascal compilers are readily 
available for a number of different desk- 
top computers. 

This means the r iurce code can be ported 
from one mr " to another using a file 
transfer program like "Kermit" and then 
recompiled on the new target machine. 
(The original simulator program was de- 
veloped on an NEC- APC 1 running CP/M- 
86 and then ported to the MS-DOS IBM-PC 
compatibles). 

The Electrical Engineering laboratories at 
the D.D.I. A.E. have a mixture of NEC-APC 
1's and CCS IBM-PC compatibles. The ex- 
ternal study centres have a mixture of 
Sperry, Hitachi and CCS IBM-PC compat- 
ible computers* For the wide range of tar- 
get computers, there was a need to make 
the system as machine independent as 
possible. All screen displays were imple- 
mented using only standard ASCII charac- 
ters for compatibility reasons. The only 
"graphics" capability used is screen high- 
lighting to improve the readability of the 
display. 

The program consists of almost 3000 lines 
of Pascal source code divided into almost 
100 procedures and functions. Half of the 
procedures were required to implement 
the 6802 opcodes. An "Include" file is used 
to handle the different program require- 
ments of the CP/M and MS-DOS ma- 
chines. (This only occurs to handle differ- 
ing screen highlighting requirements im- 
posed by different 'IBM-PC" graphics / 
screen/board combinations.) 

An "Include" file is also used to handle the 
different requirements of the D3 kit as used 
by external students and the D5 kit used by 
internal students. The differences are :- the 
page of memory available ($00 on D3, $E3 
on D5) and the addresses of the monitor 
routines and buffers. 

To meet the design criteria the following 
principles were adopted: 

18 8 
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1. A portion of the lower left-hand comer 
of the simulator display mimics the 6 
digit display window of the D3 kit 

2. Most of the 25 keys of the D3 kit keypad 
have been implemented. 



Simulator 
key 



D3 key 



Function 



0...9 / A...F "same" 



R 

T 

M 

r 

X 
V 



RS 

T/B 

M 

GO 

EX 

F/'S- 



T/B 



hexadecimal 

digits 

reset 

single step 
memory 

go 

return to prompt 

set/clear 

breakpoint 



As well for the simulator keyboard there is 
a "hidden" menu of simulator only keys. 

L load allows a machine language 
program to be loaded from 
disk 

H help displays help screens 

S save saves a machine language 
program to disk 

Z zero clears the simulator display 

Q quit quit the simulator 

P peek allows the contents of a single 
memory location (or register) 
to be displayed in binary as 
well as the standard hexadeci- 
mal 

O observe displays the contents of the 
more commonly used moni- 
tor buffers 

Y display a trace of previously 

executed machine language 
instructions (up to 20 since 
last reset) 

3. Help is available in two forms. 

a. On-line Help screens to explain specific 
feai ireso! the simulator. 



b. Provision of a number of sample pro- 
grams (exercises) together with an ex- 
planation of their operation. 

All help files are plain text files that can be 
modified using any standard editor with- 
out the need to recompile the simulator 
program. 

4. Display enhancements. 

Screen highlighting is used to make more 
readable and obvious any changes to the 
display caused by the execution of an in- 
struction. Because different hardware/ 
screen combinations give different effects 
when highlighting is used, the user is of- 
fered a choice of three different highlight- 
ing options:- higher intensity, inverse 
video, or none. 

5. Loading and Saving. 

When loading or saving a file the user is 
offered a choice of file names from a menu. 
This limited choice of file names avoids the 
problem of users forgetting their file names 
or choosing file names that clash with 
simulator system files. Enhancements of 
the simulator over the "real thing" include 
ability to save a program to disk, on-line 
help available and much more informative 
display capabilities (see figure 2). 



memory contents of a full page 
simultaneous display of all registers 
disassembly of the last instruction exe- 
cuted 

dynamic display of program counter 
and stack pointer positions 
highlighting of changes caused by last 
instruction 

ability to examine memory contents in 
binary rather than hexadecimal 
ability to see trace of last 20 instructions 
distinction on screen between defined 
and un-defined memory contents 
simultaneous display of position of all 
breakpoints 
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Limitations of the simulator. 

1. Only one page (256 bytes) of user 
memory available. The D3 kit as used 
by external students has only the single 
zero page available. A multipage D5 
version of the simulator was tested but 
was felt to be confusing with the need to 
switch between pages of display as the 
areas of memory being accessed 
changed. 

2. I/O is not simulated. Programs cannot 
interact with the real world. 

3. Interrupts are not simulated. 

4. Only a limited number of the monitor 
routines are simulated. 

5. On start up the program counter and 
stack pointer are initialised to the top 
and bottom of memory respectively 
rather than being unspecified. 

Operation of the simulator 

Figures 3 to 7 show the computer screen as 
a stored machine language program is run . 

Figure 3 (below) shows the screen with the 
program loaded from disk and the starting 
address ($E310) keyed in. 
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Figure 4 shows the screen after *he first 
instruction has been carried out. The disas- 
sembled instruction (LDAA) displayed in 
top right-hand corner and screen changes 
shown highlighted (underlined in figure). 
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Figures shows screen after jump to subrou- 
tine (JSR) with stack loaded (bottom right- 
hand corner). 

Figure 6 (on the next page) shows screen at 
end of program (HALT used to end simi ila- 
tor programs). 
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^ «*» years who did not use the simulator, led to 

tit it a » » a » ii u n ii>Jc !.' the conclusion that the simulator users had 

S ii ii li ii ii !! " \\ [\ * D " picked up the basics of microprocessor 

2! h :: » :: :: :: :: :: :; Wl ° operation in about half the usual time. 

5S !! !! •" Kck " Comments from students who had previ- 

* - » - » « " irnm ously studied this or the similar degree 

* H l*T level unit were usually that the enhanced 

5! :: :: :; ;; ;; cUlil0 display capabilities were of significant as- 

*! :: :: :: :: :: :: :: :: Mm sistance. smaii group interviews of ran- 

«. .. .. .. .. .. .. .. .. .. .. .: :: :: :: ij ;» mm domly selected students elicited a number 

of possible improvements for the Similla- 



tor. These included: 



Figure 7 shows the trace option with all 
program steps being displayed. 
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1 . Providing a selection of simple (sample) 
programs that demonstrate the usage of 
various microprocessor instructions 
(especially the monitor read and dis- 
play routines). This hasnow been incor- 
porated in the latest version. 

2. Tyingina6802cross-assemblerwiththe 
capability to download to the D3/D5 
kit. This assembler is now available for 
use by semester 2 students. 

Conclusion 



Results of student trials 

The simulator was trifcled during first 
semester 1987 with students taking the unit 
77201 - Engineering Computers. This unit, 
taught by one of the authors (Craig), intro- 
duces students to computer number sys- 
tems; computer architecture; machine and 
assembly language programming; input/ 
output methods and interfacing tech- 
niques. 

In 1987 the students received their intro- 
duction >o the 6802 microprocessor on the 
simulator. Sole instruction on the simula- 
tor was given for about 6 weeks and then 
the students were introduced to the actual 
D5 kit so they could begin using the serial 
and parallel I/O pcrts. 

Comparison of theprogressof thisgroupof 
students with students from previous 
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The simulator differs from those normally 
found in microprocessor development 
systems in that it was primarily designed as 
a teaching aid and not as a software devel- 
opment tool. The consequence cf this de- 
sign philosophy is the great emphasis that 
has been placed on such dynamic features 
as the stack pointer, condition code and 
most importantly the program counter 
(PC). Being able to watch the PC move 
through a program (with the registers and 
memory contents changing as appropriate) 
has been of great benefit; a conclusion 
supported by the very favourable reaction 
from the student users. 
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This paper challenges a number of con troversial 
epistemological issues inherent in the common 
model of Computer- Assisted Learning (CAL) in 
tertiary education in which individuals or small 
groups of students sit at a terminal and learn 
from material which presented to them, that is, 
the computer (in essence) being used in the 
traditional 'tutor' role. The central concern is 
that this model 'dramatizes the absurdity of 
continuing to think of computers, or about 
education itself in traditional ways' (Papert, 
1979). Two innovative applications of CAL 
which address these theoretical considerations 
of education will be outlined. 

The development of a framework based on an 
unsophisticated model which is being used at 
earlier levels of education enables the use of the 
computer as a 'tutee', and as a means of aiding 
and stimulating tertiary students' thinking. 
The subsequent application of the 'tutee ' frame- 
work to teacher education is proposed as a 
means of encouraging teachers to develop an 
interest in using the computer as tutee, rather 
than just as a tutor and so become a more useful 
educational tool. The two applications, devel- 
oped through co-operation between two educa- 
tors in different vocational disciplines demon- 
strates the value of the CAL educator's ability to 
apply imagination and innovation to instruc- 
tional design. 

Replication of traditional instructional 
models rather than innovative variations of 
these techniques has been suggested (Pa- 
pert, 1979; Sims, 1986) as a reason behind 
the failure of computers to achieve their 
potential as an instructional resource. Sims 
(1986, p. 262) states that The versatility of 
the computer has been neglected through 
if s use as a surrogate instructor'. Rightly, 
he argues the need for the training of teach- 
ers in the use of computers as instructional 
tools. Courseware quality, he describes as 
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being dependent upon teachers acquiring 
knowledge, experience and competency in 
authoring skills and that 'armed with these 
skills, the author has the opportunity to be 
creative in design by using the instruc- 
tional versatility of the technology 7 (Sims, 
1986). He specifically mentions the need 
for imagination in utilizing the interactive 
capabilities of the learning medium. Inter- 
active qualities are frequently discarded in 
the application of the computer as a tutor, 
whether the 'mode 7 be Tutorial, Drill and 
Practice, Simulation or Testing techniques. 

It seems to me that the dilemma fn^ed in 
striving to achieve the goal of high quality 
courseware comes largely from the notion 
that the starting point for the development 
of all courseware requires the application 
of either an authoring language or an au- 
thoring system. The starting point, Icon- 
tend, is the nature of the knowledge area in 
which the educator identifies a need to 
facilitate or enhance students 7 learning 
ability . A statement of the educational 
objectives underlying the need to learn the 
particular subject material is essential as a 
means of defining the nature of the infor- 
mation or knowledge. It is necessary to go 
back as far as defining the very beginning 
educational concepts, such as, why it is 
necessary for students to acquire this infor- 
mation. Having locked ourselves into the 
notion that authoring languages and sys- 
tems are the cornerstone for computer-as- 
sisted learning it appears that wemay be on 
a misguided mission as we attempt to find 
subject materials which we can apply to 
these authoring tools. 
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As an educator concerned about factors 
which affect the incentives, efficiency and 
effectiveness of stud its' learning, I feel a 
responsibility to *jcognize the areas of 
learning which students find particularly 
difficult due either to monotony, complex- 
ity or unfamiliarity with the material or 
concepts. Having recognized the educa- 
tional problem, my responsibility extends 
to exploration of the most appropriate 
means to alleviate the difficulties. In the 
production of the interactive video lessons 
required to provide exposure to real client 
examples for Health Science students, the 
importance of an authoring language (PC 
Pilot) was indeed recognized (Farrow, 
1986). In this instance, the identified educa- 
tional need was for students to transfer 
static information in the form of facts, dia- 
grams and illustrations into a dynamic, 
motion based concept as a means of inte- 
grating principles, and facts into clinical 
practice. 

Recently, a need has been identified to in- 
crease motivation within Health Science 
students to learn medical vocabulary and 
the relevant abbreviations which com- 
monly appear in client files, medical re- 
ports and student lecture notes. The educa- 
tional problem is that the content is boring 
and requires rote learning, notunlike learn- 
ing to spell in primary school. Although 
some aspects of the terms do not refer spe- 
cifically to medical or scientific terminol- 
ogy (Young & Austin, 1979, p. 8) as they are 
a part of words in ordinary speech, unfor- 
tunately, until these terms are learned in a 
medical context as well as learning the 
additional specific medical terms, the stu- 
dent is unable to even begin to understand 
terms used in subjects such as basic anat- 
omy, physiology and the aetiology of 
medical conditions. There exists an abun- 
dance of texts which contain the facts to be 
learned, the educational need was supply 
to find a motivating and interesting way of 
practising the use of th? information and 
not one of collecting and collating together 



the information to be learned (Steen, 1971; 
Young & Austin, 1979). 

When considering the most appropriate 
CAL mode for this educational problem, it 
was felt that whilst the preferred choice, a 
drill and practice programme would pro- 
vide students with the opportunity to prac- 
tice learning and using medical terminol- 
ogy, three major problems occurred in the 
application of this learning mode. Firstly, 
the number of medical terms and their 
abbreviations are in the region of thou- 
sands and vary both nationally and inter- 
nationally. Secondly, there are multiple 
examples for the prefixes and suffixes used 
to make up medical terminology and 
coupled with both ordinary speech words 
and medical words , the inclusion of exten- 
sive examples would necessitate the link- 
ing of unrealistically large data files to a 
drill and practice lesson. To give examples 
to these problems:- 

1. With respect to medical abbreviations; 
in different contexts, 1-E' may mean left 
eye, lower extremity or lupus erythe- 
matosus. 

2. With respect to medical terminology 
the prefix 'ab' means away from and is 
used in the words abductor ( leading 
away from) , aboral ( away from mouth) 
and many more. 

3. A drill and practice lesson is usually 
undertaken individually by students, 
an aspect which as an educator, I believe 
CAL has the potential to overuse with 
detrimental effects. 

An exciting program, Shrink V Stretch 
(WESOFT,1983) is designed on the 'tutee' 
(Taylor, 1980, p. 4) in that the computer 
presents a contraction such as 'wasn'f , to 
be matched by the expanded form, in this 
case 'was not'. The student is then asked to 
test the computer on a contraction known 
by the student. Through this form of scor- 
ing game, in which the student scores if the 
computer either cannot match the contrac- 
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tion presented by the student, or the 
computer's presentation is matched cor- 
rectly, the student is contributing, initiat- 
ing (Hancock, 1985, p. 21) and drawing on 
knowledge already learned rather than 
simply following instructions. The pro- 
gram has extensive interactive aspects, an 
element frequently dibcarded from other- 
wise excellent courseware (Sims, 1986). It 
appeared that, if used by small groups of 
students, there existed in this type of pro- 
gram, the potential for each student to 
learn something about how hisor her own 
thinking works' (Taylor, 1980, p. 4) com- 
pared with other students <u the same aca- 
demic level. Having observed the enthusi- 
asm with which numerous young adults 
(the age applicable to the majority of 
today's tertiary students) not only enjoy 
arcade games but will work apparently 
tirelessly to beat their previous scores, an 
attempt to design an adult version of a 
'Skrink 'n' Stretch' seemed worthwhile. 

Discussion about the feasibility of writing 
the proposed program led to an arrange- 
ment whereby the writing of a 'framework' 
for the program was undertaken by an 
educator in the field of teacher education. 
The basis for this arrangement was that the 
'framework' of the program could then be 
available for trainee teachers to use to 
develop confidence in using computers in 
their regular teaching (Anderson 1984, p. 
88). By teachers developing and evaluat- 
ing in the classroom programs based on the 
'tutee' model for topics such as capital 
cities matched tostatesorcountries thereis 
a potential for teachers to become clearer as 
to why they would introduce the computer 
to the classroom as an educational tool 
(Anderson, 1985). 

Written in basic for the Apple GS, the pro- 
gram is short and simple and links to a data 
file into which the educator inserts a lim- 
ited number of clear or pertinent examples 
(between 20 a 1 100) of subject content. As 
the student(s) add more known examplos 
O 1 
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the data file increases similarly. It could be 
argued that the 'framework' is in itself an 
authoring language, however, the innova- 
tive element of the program is the capacity 
for the student to reach the computer, thus 
eliminating the need for the computer to 
hold an exhaustive store of correct facts 
which must be 'judged' against student 
responses. 

The program has no facility to detect an 
incorrect answer which has not been in- 
cluded as one of the initial pertinent ex- 
amples in the data file except by the educa- 
tor regularly checking the data file as it 
builds up with further student examples. 
To add an exhaustive data file of correct 
answers against which students could 
check their own answers would defeat the 
innovative and exciting aspect of the pro- 
gram and once again place the computer in 
the tutor mode. 

Most C AL materials produced are based on 
the five commonly recognized modes and 
whether developed using authoring lan- 
guages or authoring systems continue to 
perpetuate the tendency for the CAL au- 
thor to place the computer in the 'tutor' 
role, the traditional model of the teacher in 
the educational process. Imagination and 
innovation have been applied to the in- 
structional design of a program designed 
to overcome the motivational difficulties 
experienced by tertiary students in learn- 
ing basic medical terminology and the rele- 
vant abbreviations. Through it's develop- 
ment in co-operation with an educator 
involved in training teachers and the sub- 
sequent application of the program 'frame- 
work' as a means to encourage teachers to 
explore potential uses of computers in the 
classroom, the applications of this tutee 
'framework' challenges a number of con- 
troversial epistemologkal issues inherent 
in the common CALITE model. 
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The Physiology Departm^r: has been in- 
vestigating the enhancement of its under- 
graduate laboratory teaching by the use of 
computer based apparatus over a number 
of years (Delbridge & Kemm, 1985) and has 
now drawn up specifications of its require- 
ments for such a 'Laboratory Machine' fol- 
lowing extensive testing of hardware and 
software. This paper discusses the results 
of these investigations using peripheral 
interfaces connected to the Apple lie and 
IBM-PC computers as well as the final 
specifications for the 'Laboratory Machine' 
for which funding is now being sought. 

The overall requirement for the machine is 
versatility, so that it can act as an intelligent 
instrument (incorporating chart recorder 
and oscilloscope functions) which can 
measure a wide range of physiological 
parameters, as a analyzer of the data gath- 
ered, as a simulator of experiments which 
are too difficult to mount in an undergradu- 
ate laboratory, and for computer assisted 
learning functions to relate and test the 
students knowledge of lecture material. A 
fully-integrated computer managed learn- 
ing package is required to allow the stu- 
dents to swap between any of these modes 
of operation, without requiring significant 
computer experienre. 



Enhanced student teaching in und ergradu- 
ate laboratories is the aim of i epla :ement of 
obsolete practical class equipment by com- 
puter-based apparatus, referred to as the 
Laboratory Machine'. The 'Laboratory 
Machine' would permit a more extensive 
range of scientific laboratory skills to be 
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acquired than with more expensive mod- 
ern conventional physiological apparatus. 
The greater versatility of computer-based 
equipment would allow new experiments 
to be performed with a more stimulating 
variety of investigations of physiological 
phenomena in a standard class arrange- 
ment. 

This paper is intended to discuss the real 
problems in the upgrading of the labora- 
tory equipment used in the teaching of 
undergraduate students in a Physiology 
department. We are faced with the com- 
mon problem in many Universities of 
upgrading our laboratory equipment for 
undergraduate students in the face of a 
declining funding and decreasing purchas- 
ing po wer for imported apparatus. Costing 
of the replacement of our 20-year old obso- 
lete and potentially unsafe equipment by 
conventional apparatus puts it well be- 
yond our means, even if we phase in the 
purchases over many years. 

We were led to investigate the use of com- 
puter based laboratory apparatus by the 
discovery of inexpensive digital oscillo- 
scopes based on the Apple lie microcom- 
puter, which we could see as the central 
data gathering device for most of our labo- 
ratory experiments. The installation of 
such equipment has been carefully consid- 
ered in a staged programme over a number 
of years. We thus purchased in Apple lie 
Computerscope for evaluation and and 
then ran a pilot project to investigate its use 
in a typical class experiment using four 
such instruments (Delbridge & 
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Kemm,l985). We were able to compare 
costs of conventional and computer based 
apparatus, putting us in a good position to 
argue their relative merits when seeking 
funding and also to justify the develop- 
ment and evaluation of a prototype which 
would allow the development of specifica- 
tions for the final laboratory Machine'. 
The testing phase using the IBM PC as a 
reference machine is virtually complete. It 
is felt that it would be most cost effective to 
have a single company tender for the deliv- 
ery of a whole system to our specifications, 
so that all components of the 1-aboratory 
Machine' are integrated into a coherent 
package and so that a commercially viable 
completed package is available. 

The Department of Physiology and the 
Medical Faculty of the University of Mel- 
bourne have provided approximately 
$50,000 over the last fouryears for software 
and hardware. Two academic and one 
technical staff member have also had a 
significant involvement in the project in 
this period. IBM have also been of consid- 
erable assistance by providing up to four 
computers for development and evalu- 
ation. 

Specifications of the laboratory 
machine 

We have drawn up a detailed specification 
of the minimum performance required of 
the laboratory Machine', although only 
the general specifications are included 
here. It describes the requirements of the 
transducers, amplifiers and couplers, elec- 
trical stimulators, data sampling rates and 
precision, data logging and review, display 
requirements, data storage and data re- 
view facilities. Some of these features are 
covered in Appendix A. 

Although the IBM PC was used as a proto- 
type, the computer to be used is not speci- 
fied since changes in such hardware are 
very rapid and the final choice will depend 



on compromises between cost and facilities 
offered as well as the ability of the machine 
to operate a significant range of commer- 
cially available simulation software and 
other packages. Similarly, the choice of a 
network and file serving computer to dis- 
tribute software and data should also be 
delayed. Connected to the computer, we 
prefer a free standing unit which houses all 
the electronic couplers and amplifiers, so 
that the computer can select the appropri- 
ate devices required in particular experi- 
ments, without the time consuming task of 
the technical staff having to setup the appa- 
ratus for particular experiments. This is 
especially important when the apparatus 
will be in much more intensive use than 
many separate pieces of conventional ap- 
paratus. 

Overall specifications 

Tl^e 'Laboratory Machi^.f comprises a 
computer with its operating and applica- 
tions software, together with amplifiers 
and electronic coupling and the devices 
which measureor control the physiological 
parameters being examined. The labora- 
tory Machine' is required to operated in the 
widest range of physiological studies, us- 
ing an integrated software package to use 
the full facilities of the machine. 

This computer managed learning package 
would have four major areas of operation 
in the laboratory class. These are: 

1. As an instrument for data acquisition 
and control in physiological experi- 
ments, operating as an oscilloscope, 
chart recorder and stimulator. The 
chart recorder function \ mid inuuue a 
rolling screen display and a slow data- 
logging mode direct to an ink-jet 
printer. Data would be directly stored 
to disk for later review or hardcopy. So 
that this one instrument can replace a 
variety ot standard physiological appa- 
ratus, it must be versatile and easy to 
setup and use in a wide range of labora- 
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tory situations. A range of electronic 
couplers and transducers would be 
required. The computer should be able 
to control the sensitivity of the couplers 
or amplifiers. 

2. Analysis of experimental data using 
statistical tests, curve fitting and com- 
parisons with class or published data. 
In many experiments data gathering 
would proceed slowly in the back- 
ground over a long period, allowing 
concurrent operation of a progressive 
review and manipulation of previously 
acquired data 

3. Computer-assisted learning as an aid to 
directing students towards various 
experimental investigations and to re- 
lating material presented in the lecture 
course. 

4. Simulation of experiments where the 
procedures are too difficult or expen- 
sive for an .ndergraduate class. This is 
seen as an adjunct to real laboratory 
experience and not a replacement. The 
computer-managed learning package 
must be able to swap easily between the 
four areas, with data gathered during 
the experiment able to be examined or 
operated upon in any other area. 

Operation of this management package 
must be easy for lecturers and tutors, who 
will be required to link various routines 
within a computer-assisted lessor. These 
lessons would include gathering of data 
from experiments or simulations, student 
analysis of data, and questioning the stu- 
dent before and after the experiments. 
These academics can be expected to be 
familiar with using computers with stan- 
dard software packages, but should not be 
expected to have any professional pro- 
gramming skills. 

Management software should be based on 
a Window a^d Menuing system, prefera- 



bly mouse-driven, to give optimum user 
interaction. Changes in parameters for 
printing, display, data acquisition rates, 
stimulus parameters are to be be easily 
made using on screen displays. A colour 
monitor is required, particularly for dis- 
plays of multiple graphs and in simulations 
involving complex diagrams. Data ac- 
quired from experiment or simulation may 
require further analysis, which is not pro- 
vided in the package supplied. The data 
should be able to be exported to standard 
"user-friendly" packages. 

Development of the specifications 
of the laboratory machine 

There have been two major phases in the 
developmentofourdetailed specifications. 
These were the pilot project involving the 
App 1 *; He in a typical physiology class and 
then using the IBM PC as a testbed for new 
software and hardware which would be 
used in the wide range of physiological 
measurements. 

Pilot project using the Apple ][e 
Aims 

The specific questions we sought to answer 
in the pilot project were: Could the com- 
puter-based apparatus perform as well or 
better than conventional apparatus as a 
data acquisition instrument? Was the 
apparatus acceptable and easy to operate 
by undergraduate students? Could com- 
puter managed learning improve student 
understanding of the experiments and 
their relation to lecture material? Were 
simulated experiments a useful supple- 
ment? 

Results 

We found reasonable answers to the above 
questions and indications of future direc- 
tions which might be appropriate tor fully 
developing computer based apparatus. 
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As an data acquisition instrument, the 
Apple Computerscope performed better 
than an affordable digital oscilloscope. The 
provision of a hard-copy of the results 
during experiments was the highlight of its 
operation for many students. 

Themajorityof thestudents were confident 
in the operation of the instrument after a 
brief familiarisation lesson on the com- 
puter, although some students still had an 
aversion for computers. (Its operation was 
simplified from the commercially available 
package by using a specially encoded key- 
pad which allowed access to a limited 
range of the functions available to an expe- 
rienced user of oscilloscopes. The software 
was also configured so that it started up in 
the appropriate mode for particular experi- 
ments.) 

The students did show a better apprecia- 
tion of the experiments they were perform- 
ing and their relationship to lecture mate- 
rial, although the it was not possible to 
distinguish between dependence of this 
improvement on the computer managed 
learning component or greater interest in 
the project produced by its novelty. 

The simulated experiments were both 
popular and useful, since they bridged the 
gap between the lecture material which 
was more closely related to the data ana- 
lysed in the simulation and the less direct 
measurements on the phenomena which 
could be investigated with class equip- 
ment. 

Conclusions from pilot project 

The major criticism of the apparatus used 
in the pilot project was that the software 
available on the Apple He for the individual 
components of computer-managed learn- 
ing exercise (data acquisition, computer- 
assisted learning and simulation) could not 
be integrated on the Apple lie because of 
incompatible languages, unsuitabilty of 



software for user customisation and lack of 
local support from suppliers. It was also 
difficult to modify the software to present 
simple and relevant screen labeling for 
student use. 

The pilot project only looked at one type of 
experiment which is normally performed 
in undergraduate physiology classes. 
There are a wide range of parameters 
which are normally measured iu animal 
and human experimental physiology and 
these are indicated by the descriptions of 
the current experiments (Appendix B) and 
by the range of transducers and couplers 
which would be required in the future 
(Appendix A). 

It wasconcluded that the Apple He wasnot 
a suitable machine for a major re-invest- 
ment because of declining support for data 
acquisition modules and because better 
software and hardware was becoming 
available for the IBM PC and Apple Macin- 
tosh. It was decided to proceed with the 
investigation on the IBM PC because of its 
open-architecture, colour facilities and the 
interest in local software groups in devel- 
oping both the data acquisition and com- 
puter aided-learning facilities. 

A prototype system based on the IBM PC 
was developed to demonstrate the remain- 
ing facility which was not available ( a 4- 
channel chart recorder) and to test the 
transducers and couplers which would be 
required for a full range of class experi- 
ments. 

Development and performance of a 
prototype laboratorj machine (based on 
the IBM PC) 

The prototype was designed to answer two 
broad questions: 

1. Could we source the hardware and 
software, other than the computer, 
within Australia? 

2. Could the prototype machine provide 
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satisfactory performance so that we 
could confidently demonstrate to fund- 
ing authorities that there was a better 
alternative to conventional laboratory 
apparatus. 

The specific tests we had to perform to 
satisfy these requirements were: 

1. to evaluate the existing hardware and 
software which would permit data ac- 
quisition and the development of com- 
puter aided learning of the type we had 
investigated on the Apple He and to see 
whether there would be any problems 
in integrating their operation. 

2. to seek and test suitable amplifiers and 
couplers from local manufacturers. 

3. to have a local software group develop 
4-channel chart recorder software. 

Performance of prototype and compari- 
sons with commercially available 
apparatus (for student use) 

There are many authoring systems and 
many data acquisition systems available, 
but there is no integrated approach which 
combines oscilloscope and chart recorder 
functions with computer assisted learning 
and simulations all within the one ma- 
chine. A number of Physiology Depart- 
ments in the U.K. and elsewhere have 
published reports on their use of micro- 
computers as either data gathering ma- 
chines in undergraduate laboratory classes 
or simulations or for computer-aided test- 
ing instruction. Many of the small comput- 
ers (e.g. BBC and Apple He) in use are not 
suitable for a fully integrated approach. 

The current state of development of the 
hardware and software which might be 
suitable for use in the 'Laboratory Machine' 
and other sources are described in the fol- 
lowing section, together with comments 
about a few commercial data acquisition 
systems. It should be stressed that we 
require an inexpensive system, so that 
many of the research-oriented devices are 
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unsuitable on price as well as complexity of 
operation. 

Software performance 

Laboratory Software Associates (LSA of 
Melbourne) have produced a pre-release 
package vvhich shows the feasibility of a 4- 
channel vertical chart-recorder on an IBM- 
PC. We tested this extensively in parallel 
with a conventional Grass 4-channel re- 
corder in a research laboratory which 
measures many of the parameters likely to 
be encountered in undergraduate classes. 
A number of suggestions have been made 
to improve the package and LSA have 
provided an updated version for evalu- 
ation. A slow chart-record using an ink jet 
printer needs to be developed. 

Their general purpose data acquisition 
package (DAOS) already has most of the 
facilities required for the oscilloscope pack- 
age. This package was originally devel- 
oped for the DEC PDP-11 computers and 
received worldwide acceptance. DAOS is 
now available on the IBM PC, although 
some work would be required to provide 
the facilities in the specifications of the 
'Laboratory Machine'. The cost of the full 
DAOS package is too high for general stu- 
dent use ($3,100 per copy with up to 30% 
quantity discount) Many of its features 
would not be required for teaching, so a less 
expensive mn-time system would be used 
on student machines and the full version 
for program development. 

Microcraft (Melbourne) have produced 
and authoring system ('Author') which 
would be satisfactory for computer as- 
sisted learning. Preliminary discussions 
between Microcraft and LSA have estab- 
lished the feasibility of linking their soft- 
ware packages. 'Author' also has the abil- 
ity to be linked to simulation software and 
would probably form the foundation for 
the overall computer-managed learning 
package. The price or this package (approx! 
$600 for quantity) is reasonable. 
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There are a number of simulation packages 
available for a variety of PCs, some of 
which would need to be re-written for use 
on the computer chosen. 

The major limitation in software is theover- 
all management package which is not cur- 
rently being considered by any of the soft- 
ware groups which have been consulted. It 
would not be a very difficult task to adapt 
the Authoring and data acquisition pack- 
ages to operate within such a management 
package. 

We have examined many alternative sys- 
tems including MacLab System (Otago, 
N.Z.) based on the Apple Macintosh This 
has some features not yet available in the 
LSA software for the IBM. The latest infor- 
mation we have shows that they have an 
excellent software package available for 
data-gathering with oscilloscope func- 
tions, and a chart recorder function has 
been released. There is no computer as- 
sisted learning option. 

Coulbourn Instruments (U.SA.) Vide- 
oGraph software operates their standard 
physiological couplers via an IBM-PC, but 
this appears not to have all the features 
required for our measurements andhas no 
computer assisted learning facilities. 

There are many other packages for data 
acquisition, but their suitability would 
depend on price and whether or not they 
could be integrated into a management 
package. 

Hardware performance 

J-RAK Instruments (Melbourne) produce 
conventional couplers for physiological 
measurements using standard chart re- 
corders and these have been purchased for 
evaluation with the chart-recording soft- 
ware on the IBM-PC. So far we have tested 
the bridge couplers and universal couplers 
successfully. A prototype Cardiac Output 
device has been briefly tested and will need 



some modification before it is used in con- 
junction with the computer. They also have 
a stimulator under development. 

This department has designed and built, 
for the Apple-He pilot project, general- 
purpose pre-amplifiers for recording ex- 
tracellular potentials in man and animal. 
These have been designed with optically 
isolated inputs so they could satisfy safety 
standards for recording from patients. J- 
RAK have built a similar unit based on this 
design, which we will evaluate. 

When using equipment in large under- 
graduate classes, it was found unaccept- 
able to have ambiguity in the control of 
modules by either the computer or by a 
switch on a panel of a coupler. The conflict 
between controls on the front panel and 
any computer controlled gain would have 
to be resolved by covering the front panels 
or ty modifying the J-RAK modules. 

The Otago (N.Z.) couplers for Ihe Macin- 
tosh consists only of 4 general purpose 
electrophysiological amplifiers, with none 
of the other couplers we require being 
mentioned as under development. Their 
amplifiers all have complete computer 
control of gain. They are working on a 
stimulator module. Their apparatus cur- 
rently performs some of the laboratory 
functions specified. It could beenhanced to 
satisfy our requirements, perhaps with the 
assistance of J-RAK, although colour op- 
tions on the Macintosh II are very expen- 
sive and the small screen monochrome 
Macintosh limits its appeal for complex 
diagrams. 

Coulbourn Instruments (U.SA) have an 
incomplete range of physiological couplers 
and transducers available, but again they 
are principally designed for operation in- 
dependent of the computer and would 
require modification to provide an inte- 
grated operation with the computer in 
control. 
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Nucleus (Sydney) produce a satisfactory 
IBM-PC computer interface board to con- 
nect to the couplers and this is supported 
by the LSA software. All other interface 
boards (which allow timing and conver- 
sion of the incoming signals to digital val- 
ues for the computer) are imported, at 
greater cost. 

There are many special purpose data-log- 
gers and oscilloscope systems based on the 
IBM-PC, but most are expensive and de- 
signed for research purposes. No commer- 
cial systems are yet available with a satis- 
factory range of couplers which are inte- 
grated with the computer system. 

Comparisons of costs: 
Conventional apparatus versus 
laboratory machine 

One of the strong arguments for the use of 
computer based equipment is the potential 
cost savings. The individual items of 
equipment are less expensive, and the 
apparatus is more versatile than conven- 
tional equipment, so we will need fewer 
pieces of apparatus. The versatility of the 
apparatus means that it will bo in more 
constant use in laboratory classes, and can 
also be used for student revision outside 
normal class times. 

Our Physiology Department requires 42 
laboratory Machines' for its normal com- 
mitment for undergraduate laboratory 
classes for 130 Medical, 50 Dental and 200 
Science students. These machines could 
also satisfy the requirements of the Phar- 
macology department classes, given 
timetabling adjustments or a slight in- 
crease in numbers of machines. £ludents 
would work in pairs in most experiments 
and in fours when the experimental proto- 
col required group investigations. 

We examined another University Physiol- 
ogy Department's inventory of modern, 
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but conventional, laboratory apparatus 
and costed its replacement at current 
prices. The apparatus included 4-channel 
chart recorders, 2-channel storage oscillo- 
scopes, stimulators, spirometers, amplifi- 
ers, transducers and couplers. The esti- 
mated 1987 replacement cost would be 
over $27,000 per student workplace (as- 
suming work in pairs in most experiments 
and in fours for the remaining experi- 
ments). This compares with our current 
estimates of approximately $13,000 for 
computer based equipment. The price of 
computer based equipment is likely to fall, 
or its performance increase, while the 
conventional equipment price could rise 
further. Also the major cost of the com- 
puter system, couplers and amplifiers, 
would be significantly reduced by larger 
orders. 

Implementing the replacement of 
existing apparatus — Future 
directions and financial 
considerations 

Further progress with the laboratory 
Machine' is now dependent on a major 
financial commitment by the Physiology 
Department or others to purchase a com- 
mercial number of machines. We are cur- 
rently seeking funds with some urgency, as 
our obsolete equipment is becoming un- 
serviceable. Whether the final computer is 
based on an IBM, Macintosh or other com- 
puter, no system has reached the specifica- 
tions required to perform the wide range of 
physiological measurements which would 
be undertaken (Appendix B), let alone the 
integrated approach of combining data 
gathering, analysis, simulations and com- 
puter aided learning within one computer 
package. 

x ne individual components required have 
been demonstrated as being viable, but 
their final development requires that there 
be a large enough order to finance the rela- 
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ti vely simple task of providing the manage- 
ment software and production runs of 
couplers. This will require that a depart- 
ment takes the first step by it self, or a group 
of Physiology and Biological Science De- 
partments form a consortium of buyers to 
draw up common specifications and call 
for tenders. The latter approach has many 
advantages, particularly in the pooling of 
resources in the development of applica- 
tions software for simulations and for de- 
veloping experiments which use the spe- 
cial expertise of each department. 

We believe that the 'Laboratory Machine' 
can be produced for much less than a simi- 
larly equipped 4-channel pen recorder and 
a digital storage oscilloscope, but with all 
the advantages of computer based appara- 
tus. There seems to be a very large market 
in teaching and research for the 'Machine' 
described here and the consortium could 
attract government interest in the potential 
for export. 
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of Melbourne, pp<. i>-97. 



FSD40mm Hg 
(±20mmHg) 
0-50 Hz 

Muscle Force 

(a) FSDlKg 

(b) FSD lOg 

Muscle Length 
FSD 1cm 

Core Temp. 
35-39 °C 
0-0.1 Hz 

Resp. Flow & 
Volumes 
(MO Hz 



Strain gauge 

Optical? 
Thermistor 

Turbine etc 



2 Extracellular Specific 

Potentials (FSD's) Ag Electrodes 
ECG .Q3-150Hz,10mV 
EEG .05-SOHz, IroV 
iIMG 10-6 KHz, lOmV 
NERVE .(BHz-lOKH^lOmV 

1 PCG 5Hz-2KHz Microphone 



1 Cardiac Output 
(Imp. Method) 



Monitoring 
Electrodes 



2 Auxiliary Inputs Devices with 
(general use) own bridge etc. 
Frog Skin 200mV with Offset, 



1 Double Pulse 
Stimulator 



1 mV 



Bridge & 
D.Camp 



Special 
Coupler 

Bridge & 
D.Camp 



Special 
Coupler 



Optical- 
Isolated 
Pre- 
amplifier 



A.C 

Amplifier 

Spedal 
Interface 

Differential 
DC. Amp. 
Ampiifi< 
tion, 

Attenuation 
& 

Filtering. 

Stimulus 
Isolator 



Appendix A 

Indicates the requirements for transduc- 
ers and couplers in the Department of 
Physiology. 
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Appendix B 

Outline of requirements of current 
laboratory experiments and the 
laboratory machine* in first and 
second year Physiology classes. 

The variety and technology required to 
perform experimental physiology is not 
widely appreciated, so an outline of the 
experiments currently performed is given 
below. As well as describing current 
experiments^pr / 2i}d Year physiology 
/C \J O 
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classes, indications are given of the easy 
upgrading of these experiments. How- 
ever, new experiments will also need to 
be devised, or adapted from other institu- 
tions, to further modernize the teaching 
programme. Final year experimental 
physiology experiments are not included, 
since they are usually performed in small 
groups and are more easily adapted to 
change in equipment or emphasis by the 
lecturing staff. We would expect to be 
able to present students with challenges 
much closer to the experimental physiol- 
ogy they might encounter in their future 
workplace. 

One of the significant advantages of the 
new equipment is that more experiments 
will be able to be performed on human 
subjects with the greater data gathering 
and analytical power of the computer 
based apparatus. 

Experiment 1: Permeability of Cell Mem- 
branes 

Demonstrates the factors influencing the 
transport of materials across membranes 
using erythrocyte and yeast cell.lt requires 
no computerized data acquisition or any 
particular laboratory 

Computer Simulations could considerably 
assist the students understanding of diffu- 
sion, osmosis, isotorricity and active trans- 
port mechanisms. Computer assisted 
learning would also be important for this 
conceptually difficult area of physiology. 

Experiment 2: Characteristics of Skeletal 
muscle 

Examines the factors which influence the 
development of force following electrical 
stimulation of the isolated toad muscle. 
Fast data acquisition, in oscilloscope mode, 
of muscle force and length is required, with 
the possible addition of recording the elec- 
trical activity of muscle (EMG) and recep- 
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tors. New transducers and muscle bal^ 
are required, particularly if another muscle 
(e.g.sartorious) is used to allow direct 
stimulation of the muscle, rather than via 
the fatigue prone neuromuscular junction 
used in sciatic/gastrocnemius. It is pos- 
sible to introduce human muscle studies 
using EMG and force measurements (if 
additional heavy duty force transducers 
are purchased). This may be an optional 
facility for students proceeding to exercise 
physiology. 

Experiment 3: Action potentials in periph- 
eral nerves 

The current experiment examines the char- 
acteristics of Action Potentials initiated by 
electrical stimulation in the sciatic nerve of 
the toad. This requires fast data acquisition 
in oscilloscope mode. It could be extended 
to study the transmission of activity across 
the neuromuscular junction by simultane- 
ously recording the electrical activity in the 
attached gastrocnemius muscle. The 
Apple lie pilot study introduced recording 
of action potentials in the human ulnar 
nerve for the medical students. The previ- 
ous apparatus was not safe for human re- 
cordings and computer averaging tech- 
niques are needed for recording activity 
from sensory nerve fibres (electroneuro- 
grams ENG).Measurement of propagation 
in central pathways may also be possible in 
the human, using evoked cortical poten- 
tials. 

Simulations are important in the irea of 
membrane potentials and excitability 
where students have to deal with many 
difficult concepts. 

Experiment 4: Properties of smooth muscle 

Examines the control of the rhythmical con- 
tractions and overall tone of visceral 
smooth muscle of the rabbit in an organ 
bath. The importance of local environ- 
ment, temperature and humoral agents are 
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examined. Slow data acquisition using the 
chart recorder mode is required to measure 
the rhythmical contractions. A sensitive 
isotonic length transducer is needed. The 
computer could calculate the frequency of 
the underlying rhythm while recording the 
cyclical length changes. 

Experiment 5: Haematobgy 

Involves the analysis of the students own 
blood. No on-line data acquisition is re- 
quired although a central computer would 
assist in the collation of class results. Re- 
sults from some of the more modern ana- 
lytical machines could be directly interface 
to the central machine. These could now 
include blood gas analysis. 

Experiment 6: Cardiac muscle 

Investigates the properties of cardiac 
muscle in the toad, relating the sequence of 
events and the coordination of contraction 
of the heart chambers. The experiments 
could be supplemented with the new 
equipment to include a pseudo-intracellu- 
lar recording of ventricular action poten- 
tials (using a suction electrode) so permit- 
ting a better understanding of the electrical 
events associated with contraction. 

Experiment 7: E.C.G. and heart sounds 

Investigates the ECG (electrocardiogram) 
and PCG (phonocardiogram) in the hu- 
man. Experiments are also performed with 
the exposed heart of the toad, so that the 
basis of the ECG recordings can be appreci- 
ated. These experiments would be consid- 
erably improved when two channels of 
recording can be made. The ECG and PCG 
can be simultaneously recorded without 
the confusion of superimposing their elec- 
trical signals in a single record. Vector 
cardiograms can also be generated from 
two simultaneous ECG recordings. The 
ability to record the ECG with a computer 
calculation of instantaneous heart rate will 



benefit many other experiments, e.g. exer- 
cise tests.Access to stored ECG's of show- 
ing normal population variations, such as 
with orientation of the heart, would assist 
the medical student's appreciation of the 
ECG. Some abnormal ECG recordings 
night also be valuable. 

Experiment 8: Mammalian blood pressure 

This experiment investigates the control of 
blood pressure in the anaesthetized rabbit. 
This experiment would be much more 
valuable if there were more than the cur- 
rent single recording of arterial blood pres- 
sure supplemented by calculations of heart 
rate. Simultaneous recording of venous 
blood pressure would allow students to 
better examine compensatory mecha- 
nisms. The ECG could also be measured. 
The experiment would need to be re-con- 
sidered to take full advantage of the new 
apparatus which* could also include the 
measurement of cardiac output by ther- 
modilution techniques. 
Experiment 9: Haemorrhage 

This experiment investigates the cardio- 
vascular compensatory responses to blood 
loss in the rabbit. This is an important 
experiment in the understanding of cardio- 
vascular control and would be improved 
by the better monitoring of responses as 
outlined in Experiment 8. 

Experiment 10: Human blood pressure 
and heart rate 

Currently involves the measurement of 
human blood pressure and its variation 
with posture and exercise. The computer 
wou Id be of li ttle use in the measurement of 
blood pressure with cuff and stethoscope, 
but there is an important missing piece of 
information in this experiment, the vari- 
ation of Cardiac Output. The computer 
will permit the calculation of cardiac out- 
put in all these situations so that a better 
understanding of cardiovascular compen- 
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sation is possible. As well, during exercise, 
the beat to beat measurement of heart rate 
from a simultaneous recording of the ECG 
will permit a better understanding of re- 
covery mechanisms. Simulations of 
cardiovascular function are particularly 
important, because of conceptual difficul- 
ties the students have with many of the 
interdependent variables influencing the 
circulatory system. 

Experiment 11: Respiration 

Parti: Measurement of respiratory gases, 
breath-holding etc. There is no require- 
ment for on-line data acquisition. 

Part 2: Lung volumes and metabolic rate. 
Students need to monitor the flow of gas in 
and out of their lungs and collect samples 
for gas analysis. There are an inadequate 
number of conventional spirometers for 
this task at present, and the use of flowme- 
ters connected to thv» computer would 
provide a more cost effective replacement. 

Part 3: Exercise responses. Currently, stu- 
dents work in large groups collecting a 
variety of data manually supplemented by 
an ECG recording to calculate heart rate. It 
will be possible to have more stu^ its per- 
forming the experiments if the chart re- 
corder directly monitors the respiratory 
and cardiovascular changes. Mosl impor- 
tantly, the measurement of cardiac output 
changes will allow a better understanding 
of the cardiovascular and respiratory re- 
sponses to a graded exercise challenge. 

Experiment 12: Renal Physiobgy 

Examines the human renal responses to a 
variety of stresses such as water and salt 
loading. There is no requirement of on-line 
data acquisition, but a central computer 
which could collate the students' extensive 
results within the various subgroups 
would considerably assist the staff in pre- 
paring for the lecture-discussion which 



occurs at the end of each practical class. It 
could also be useful for some more complex 
calculations. 

Experiment 13: Gastric secretion 

This experiment examines the modifica- 
tion of gastric secretions under various 
conditions. Some accumulation of class 
results with a single computer could be 
helpful. 

Experiment 14: Body temperature control 

This is a very important practical class for 
the students because of the significance of 
understanding temperature stresses and 
because it re-examines a wide range of 
physiological mechanisms involved in the 
integrated response to these stresses. The 
experiment would be considerably im- 
proved if cardiac output could be moni- 
tored, as well a having on-line recordings 
of ECG, respiratory flow, as well as the 
current recording of core temperature from 
the tympanic membrane via a thermistor 
probe. 

Experiment 15: Sensory and motor func- 
tions in the C.N.S. 

Current experiments use a limited number 
and range of apparatus to investigate sen- 
sory mechanisms and motor functions in 
the central nervous system, The use of 
computer based apparatus a\ the standard 
configuration with 2-4 equipped with sig- 
nal generators to act as audiometers would 
considerably expand the range of experi- 
ments which could be offered. 

Experiment 16: Structure and function in 
the C.N,S. 

This is an orientation class for science stu- 
dents to provide them with an elementary 
understanding of the relationships of 
human brain structures duringdemonstra- 
tions and investigation of prepared mate- 
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rial. No computer use is envisaged at pres- 
ent, although pre-recorded computer im- 
ages demonstrating brain scan results 
could be useful together with 3-d rotatable 
representations of the location various 
brain s juctures. 

Experiment 17: Endocrinology 

At present, the only endocrinology practi- 
cal class is an anatomical investigation of 
relevant structures in the rat. The new 
apparatus would permit students to inves- 
tigate the action of anti-diuretic hormone 
on ion transport in the frog skin as a model 
for their understanding of kidney function. 

Experiment 18: Salivary secretion 

This experiment is for the dental students 
and examines the control of salivary secre- 
tion. Some accumulation of class data on a 
single computer is all that would be envis- 
aged. 
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Interactive laser disc in Community Medicine 



Trevor Lord 

Department of Community Medicine 
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Teaching Community Medicine requires a 
great deal of small group wo/k. In order to 
provide time for this and still expose students 
to the necessary range of Information a new 
approach was required The Department 
developed a learning laboratory where the 
students could spend time working on learn- 
ing packages. The packages have taken the 
form of video, computer problem solving, car- 
omed, audio tapes and printed material 
Interactive laser disc is the latest addition to 
the learning laboratory. Some 3000 slides 
including all the departments slides have been 
written onto a 30cm laser disc Using an intel- 
ligent laser player and a touch screen monitor 
packages have been written using the laser 
disc as the material source. The department 
intends converting the software to EPROMS 
allowing free standing players and monitors 
to be set up without the need to have a com- 
puter attached. 

Much of medical teaching is based around 
clinical situations requiring live patients, 
dinicalslidesorvideo. Using computers to 
mimic the clinical situations has been lim- 
ited by this inability to provide the illustra- 
tions. Graphics have not solved this prob- 
lem. Another problem is the large collec- 
tions of clinical slides retained within the 
dinical departments. 

Laser disc offers the opportunity to have a 
source of carefully selected dinical slidesor 
video footage that the computer programs 
can then use to illustrate the clinical prob- 
lems. Large numbers of slides can be stored 
on the one disc. 

The Department of Community Medicine 
Monash University, has like many other 
departments, had its teaching resources 
stretched. The increasing pressure for 



Medicine Faculties to increase the commu- 
nity medicine components of their courses 
have added to this. There is also an increas- 
ing need to teach consulting and communi- 
cation skills a role that has fallen to depart- 
ments of community medicine. Teaching 
in this area requires high staff to student 
ratios yet the more basic content of general 
practice still has to be covered. For these 
reasons our department has been develop- 
ing learning packages for some years. The 
students in our department spend almost 
50% of their time in the department work- 
ing in a learning laboratory going through 
the packages at their own pace. The enthu- 
siasm for this kind of learning has encour- 
aged us to continue in producing more 
packages and move into computer based 
packages. 

Our Apple network based C ALS have been 
in use for three years and indude an assess- 
ment CAL that marks each student per- 
forming it and produces the scores. These 
clinical cases have always been hampered 
by the inability to illustrate them. In paral- 
lel with this has been caromed based clini- 
cal slides and video tapes of consultations 
with work through programs in booklet 
form. 

The principle behind all the programs is 
that they aie interactive with the emphasis 
on problem solving and not on presenting 
large quantities of factual information. The 
programs are kept to around 20 Oi* 30 min- 
utes completion time. 
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The laser disc technology offered us an 
ideal opportunity to combine all these into 
this exciting and fun to use medium. Our 
enthusiasm to use the medium has encour- 
aged us to go ahead with out waiting to see 
which direction the technology is going to 
develop. 

We have chosen the thirty centimetre laser 
discs because of the volume of material 
they can hold . Approximately 30,000 clini- 
cal slides can be stored on the disc or about 
30 minutesof video footage. Any combina- 
tion of slides or video can be used. The 
material for our first disc was prepared in 
South Australia and was sent overseas for 
production. We have taken a 10% share of 
this disc. This allowed us to load our de- 
partments collection of some 1,000 slides. 
We also obtained a first class selection of 
dermatology slides from a teaching Der- 
matologist, a collection of slides from 
Melbourne's Ear nose and Throat hospital 
and a collection of ophthalmology slides. A 
total of 3,000 slides. 

Our choice of hardware was based on the 
direction that we wanted the packages to 
take. We wanted the packages to be simple 
to use ideally free of computers and key- 
boards. We wanted good interactive pack- 
ages that could be easily altered or up- 
graded. We wanted the students to be able 
to select from a range of short interactive 
packages and easily start the package with- 
out supervision. 

Two directions were open. The first was to 
use a simple laser player connected to a 
computer. Install a card in the computer 
that allowed the computer to drive the laser 
player to obtain the illustrations and pro- 
duce the text for the interactive programs. 
This system required that a computer was 
constantly attached and that the student 
would need to drive the computer/The sec- 
ond option was to use the laservision tech- 
nology and thePhilips Ilvas authoring sys- 
tem. 



Ilvas when combined with an intelligent 
laser player allows the program to be 
dropped in to the player from the computer 
or from an EPROM in a plug in cartridge. 
The player can then be driven by a simple 
infra red hand held keyboard or a touch 
screen monitor. We were very impressed 
with the ease of use of the touch screen 
monitor which particularly suited our 
style of packages. 

The hardware available at that stage was 
the Philips VP835/E Laser player and the 
Philips VP120 Touch)screen monitor. The 
cost of this approach was about $500 more 
than using the computer based card sys- 
tem with a plain monitor and simple laser 
player. 

The Ilvas software runs on a IBM compat- 
ible machine using two floppy disc drives. 
It has its own operating system and is not 
currently available in a hard disc version. 
The second drivecontains the data disk. It 
generates text in videotext format suitable 
for the monitors videotext decoder and has 
commands that allow full control of the 
player. The language is Allva which al- 
lows high leve! commands. 

Asupervisorallowscontrol of the different 
modes of the program. The programs are 
made up in small simple fragments which 
are then linked. The text frames are gener- 
ated separately and called up by the pro- 
grams. The programs are compiled by 
Ilvas and can then be dumped to the 64k 
ram of the player. Once the program is 
complete and has been fully tested Ilvas 
manager can then be used to send the 
program to an EPROM burner for produc- 
tion of a chip which is then placed in a 
simple cartridge. Thecartridgecanthenbe 
labeled and available to the students in a 
fairly robust form. 

Writing instructions for the touch screen is 
relatively simple. Screen co-ordinates are 
given for the positioning of the touch sen- 
sitive areas. Corresponding coloured 
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boxes are then produced in the text frames. 
The boxes can be made to change colour 
when touched. Information as to choices 
made on the touch screen can be retained 
for scoring or later use in the program. 

Control of the player from within the pro- 
gram is also powerful. Any frame can be 
called up from the disc within 05 sees. A 
series of frames e.g. video can be played 
forward, backward, slow or fast. Sections 
can be repeatedly replayed. Writing pro- 
grams to utilize slides or video is relatively 
simple. 

Integrating the videotext output and the 
laser disc output is also easy. Text can be 
over-layed over slide frames taken off the 
disk or over running video frames. The 
video text can be altered independently of 
the laser disc material so that a piece of 
video can be run for a while before super- 
imposing videotext. Videotext can be dis- 
played by itself. The text material can be 
held on screen for a period of time moving 
on automatically or sit awaiting a prompt 
from the touch screen. Text can be in a 
range of colours with varying back- 
grounds, limited graphics are available. 
Text can be made to flash or change colour. 

The size of programs is limited by the 64k 
RAM of the player. We prefer short 20)30 
minute programs and this limitation has 
not been a major handicap except when we 
have used a lot of text material. Programs 
that source most of the illustrations from 
the disc are not affected by this. Larger 
programs could be produced and written 
on the disc as part of disc production how- 
ever this limits the flexibility of being able 
to change or upgrade the programs which 
is a serious limitation in the medical area. 
Ideally any large volume text material 
should be written on the disc as long as one 
is confident that it will stay in date. The 
advent of read)write laserdisc technology 
will resolve this problem. 

From the learners view the face of these 
packages is very attractive. The complete 



system is a simple standalone player and 
touch monitor. The student selects the car- 
tridge containing the program, plugs it in 
and switches on the player. The player 
boots from the cartridge and presents the 
information through the touch screen 
monitor. The learner touches the appropri- 
ate boxes to select choices. Clinical slides 
are taken from the disc to illustrate the 
problems. The presentation is rapid and 
colourful. The packages have a great deal 
of impact are fun to do and a very useful 
way of repeatedly presenting useful pack- 
ages. 

Our first packages were on ECG programs. 
They were surprisingly easy to produce. 
Lessons and programming ideas devel- 
oped on one package can easily be copied 
and used in other packages. The on-screen 
editing of packages can be done on com- 
puter monitor or with the TV monitor al- 
lowing quick assessment of the presenta- 
tion colours and methods. 

A number of limitations are present. The 
inability to import files from a standard 
word processor. The screen editor is rea- 
sonably good but production of text could 
be enhanced if it could be performed on a 
wordprocessor and then moved into Ilvas. 
Another problem is not being able to use 
Ilvas from the hard disc. Reading and writ- 
ingfragments to the floppy is slow and also 
hampers production. 

Overall we are very pleased with the choice 
wehavemade. Given the goals that we had 
for the package design and presentation we 
feel the Philips system has met our needs 
very well. We are keen to start working 
with video footage. At present the Royal 
College of General Practitioners (U.K) are 
mastering a dedicated 30 cm disc for gen- 
eral practice. This will include video of 
consultations as well as slides. We are 
looking forward to obtaining this as a 
source disc and developing our own pro- 
grams. 
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Monash is considering producing 30cm 
laser discs. Currently we are negotiating 
funding to produce a disc on Back-pain, 
communication skills and on AIDS. Once 
the discs are produced one can build an 
almost infinite number of programs using 
the source material. Communication skills 
will be the most challenging to produce in 
a learning package. However the ability to 
video a good counseling type consultation, 
run it slowly, freeze it at critical points, 
superimpose points and questions offers a 
unique opportunity to provide this type of 
learning. 

The la ser disc system will sol ve a number of 
problems in presenting our learning pack- 
ages. The simplicity reduces the need for 
any supervision. The presentation ensures 
the students interest. The technology al- 
lows imaginative programs to be produced 
in areas that traditionally have required 
considerable staff input. 



Trevor Lord, a medical graduate, 
spent four years in general practice 
developing educational interests 
through the Family Medicine Pro- 
gramme. Computing interests de- 
veloped through the Royal Austra- 
lian College of General Practitioners 
initially in the development of 
on)line computer assisted medical 
records. Secretary to the Colleges 
National Computer Committee, 
Victorian Computers in General 
Practice committee and 
co-ordinator of the RACGP Na- 
tional Computer Assisted Practice 
Project. Currently working in the 
Department of Community Medi- 
cine developing the departments 
computing role including produc- 
tion of patient management CALS, 
medical computing courses, medi- 
cal computing research and assist- 
ing in the development of commer- 
cial medical record, prevention and 
health promotion software. 
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Lateral teaching software: A programmer's 
perspective. 

Ralph S Sutherland & Benjamin K Selingen 
Chemistry Department 
Australian National University 



The microcomputer has opened up a new 
era in teaching tools and the time has come 
to assess its use. A project to develop 
MacFourier gave one of us (RSS), a com- 
puter programmer and a student, the op- 
portunity to explore the situation from a 
variety of angles. This paper will cover 
some of the major design parameters that 
went into the development process. Along 
the way, specific examples of the principles 
involved will be illustrated. 



User initiation and authorization. 

One of the most important parameters was 
to keep the user in control. The user de- 
cides what process occurs next, and when 
a chain of processes can be stopped. This 
'user driven mode' is especially evident in 
the software used on the Macintosh™ 
computers. It should be noted however 
that the choice of this mode of operation is 
the responsibility of the program, not the 
machine. 

A popular method of implementing this 
style of programming is to use a dendritic 
program structure. This structure has a 
central waiting loop which can detect ac- 
tions by the user, and a collection of sub- 
routines that are selected in response to 
those actions. Additional cross links and 
returning routes between the various rou- 
tines and the 'main loop' give the program 
its final behaviour pattern. Most of the 
running time is spent at the primary node 
or main event loop waiting for the user to 
act. 
O 



In a typical Macintosh application, each 
individual keystroke or mouse button 
push is intercepted individually by the 
main loop and passed to the appropriate 
handling routine, so that at any given 
moment the program is ready to respond 
to the user. In MacFourier a user can have 
just transformed a function, spotted an 
error in the transformed display and al- 
most immediately proceed to edit the 
original function. This has the obvious 
advantages. It encourages semi-random 
exploration of the program's abilities with- 
out fear of losing everything because of an 
error. It means the program will not go 
through a procedure unless and until the 
user is both ready to, and has authorized 
the operation. Thus routines that are not 
wanted for a particular run need never be 
used. 

Program restrictions on theuser are largely 
replaced by user restrictions on the pro- 
gram. The computer is placed in the back- 
ground, while problems and program so- 
lutions are brought forward. This lessens 
computerphobia. 

Non-linear program structures, 
menus and more... 

In the following examples some Macintosh 
terms are used, for which equivalent items 
and methods will be found on other mod- 
ern micros. 

Menus areamethodofoutliningthebroad 
choices available to the user at any given 
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Fourier Trasform Routine 



Main Event Loop 





Dialog 



Function Routines 
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Dialog 



Modify Routines 



Formatting Routines 




Sub-Sub routines 



Figure 1: Non linear structure of the program (not all of the returns to the main loop are 
shown)... 



time. They are enabled or disabled as re- 
quired by the program to eliminate illogi- 
cal 01 invalid options. The main event loop 
can detect a menu choice through monitor- 
ing a mouse event, and can then branch the 
program to the appropriate subroutine. 

Further choices can be made with dialog 
boxes and buttons. They can be seen as 
buffers. The "CANCEL" button, e.g., al- 
lows the user to abort and return to the 



•nam loop. Other choices are offered as 
deemed desirable. 

RelatixK values vs Absolutes. 

When comparing the fields in which 
Fourier Transforms are used an immediate 
problem quickly arose as to whose conven- 
tions to use. One text outlined no less than 
seven different conventions in expressing 
the transform and its inverse, the values of 
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Fig 2: Menubar and menu, dialog box and buttons. 



the normalising coefficients was the main 
area of disagreement. We made the deci- 
sion toavoidtheproblemaltogetherbynot 
using an explicit normalisation. All dis- 
played functions and transforms are nor- 
malised relative to an appropriate maxi- 
mum and scaled to fit the screen. As a 
consequence labeled, graduated scales for 
the displaysare not used and there are no 
restrictions in the inputting of amplitudes. 



A menu option can be used to scale down 
amplitudes for display. Dialog boxes 
make use of 'intuitive' ranges such as 
amplitudes of 0-1, and the centre of dis- 
tributive functions can be placed on a 0-1 
scale without using explicit channel num- 
bers. This is just one of the steps taken 
towards simplifying operations and giv- 
ing the user more time to think about the 
physical issues involved. 



Reciprocal Areas 




Fig 3: The Qualitative Uncertainty Principle, note the lack of absolute scales, yet the trend 
(and so the idea) is immediately obvious. 

O 
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Levels of volunteered information, 
towards 'qualitative' programs 

This trend towards a more qualitative 
approach became an important aspect of 
the design philosophy of MacFourier. 

Visual feedback during processes 

In order to allow the user to see what was 
happening at any given time, the modify 
and function operations can be seen evolv- 
ing on the screen as they are carried out. 
Unfortunately the structure of the trans- 
form algorithm itself does not allow a 
similar approach tc be used. This leaves 
the transform operation as somewhat of a 
Tjlack box'. However the whole point of 
the program is to look at the properties of 
this / box / rather than understand its par- 
ticular algorithm. 



Visual Feedback 
Multiplication (t tqusrewave by an exponential )L 




Fig 4: Visual Feedback. Simple operations 
are demistified by being displayed as they 
are being executed. 



Allowance for creativity 

Choices were made as to what basic func- 
tions should be included for the purpose of 
constructing functions and transforms. 
The final list of functions and operations 
included the modify menu allowed the 
construction of the simulations and prob- 
lems found in all the reference texts. To 



construct some arbitary function seen in a 
text or otherwise desired requires some 
creative effort, the construction methods 
are not always obvious. 

Active exploration of limitations of 
computer (especially digital) 
techniques 

During development, one of the test func- 
tions used to test the algorithm was a 
square wave, which should theoretically 
give a purely imaginary transform. It 
doesn't! The 'error' can be tracked down to 
a fundamental problem of using a finite 
representation of the function and trans- 
form, i.e. the dif jince between a Fourier 
series and a Fourier integral. 

Rather than trying to reduce the effect by 
increasing channel numbers or introduc- 
ing sophisticated interpolation — smooth- 
ing algorithms eto, this 'error' was left in 
the program operation and emphasised in 
the teaching process as a fundamental 
property of any digital transform process. 

General applicability to many 
fields, efficient use of 
programming resources 

Fourier Transforms were selected as the 
first of the lateral teaching topics because 
they provide a general purpose tool com- 
mon to many fields of study and therefore 
represented a teaching redundancy. In 
addition the usual mathematical ap- 
proaches often did little for the student's 
understanding of the physical aspects that 
were the real learning objective. In addi- 
tion, all the processes critically related to 
the Fourier Transform, such as correlation 
and convolution, could easily be linked. A 
major obstacle to be overcome was to pro- 
vide a translation for the local dialects used 
to explain basically the same concepts 8 \ 
each of the different fields. Thus the spec- 
troscopists' dispersion/absorbsion curve 
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A Weakness of Digital Techniques. 
Finite Representation error. 
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Fig 5: The finite number of frequencies available to form a transform gives rise to the low 
fence of real spikes in the transform of a square wave. If the real component is removed 
by filtering etc, and the resulting spectrum is inverse transformed, a square wave is 
obtained that has zero 'crossover" values; these are not present in the original. As the 
contributing sinusoidal waves all have zero values, the zero crossing can only disappear 
in the limit of an infinte series. 



is related to the sound-engineers log/log 
frequency response curves; the general slit 
function to the electronic system transfer 
function and so on. The similarities in dif- 
ferent fields can be found just under the 
surface of the different conventions. One 
can go on. Any spectrum is a fburier trans- 
form. In physiology, the ear is treated a 
real-time continuous audio frequency 
fourier transformer. Alensisaiwo-dimen- 



sional transformer of the optical images. 
Bringing together disparate fields under a 
common rubric is our central theme. 

There is nothing new in programming a 
computer to perform fourier transforms. 
The important thing here is a tool that can 
be used to mimic a tremendous variety of 
apparently unrelated problems/situ- 
ations, and then to explore the relation- 
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Fig 6: Any Spectrum is a Fourier transform. 
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ships that exist between them. The user can 
concentrate on the meanig of the transfor- 
mations to his pro jlem and not be con- 
cerned at this stage with a whole set of 
notational conventions or spend time 
understanding the transform algorithm 
itself. 



Fig 7: Fcurier Transforms used in Image 
processing 



Time domain data handling operators 
in the frequency domain. 



Fig 8: Many common, and 
apparently disparate data 
processing operations are in 
fact more closely related in 
the Fourier domain than in 
their original one. Differ- 
entiation (first order) of a 
function is equivalent to 
multiplying its tran "tformby 
the imaginary ramp funct- 
ion, whereas frequency 
filtering can be achieved by 
multiplication by similar 
real ramps. Filtering can be 
related to convolution or 
deconvolution. 
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Convolution and The Fourier Transform . 
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Kg 9: The nature of convolution can be illuminated by seeing the operation as the multi- 
plication in transform space. The lateral design of MacFourier allows a user to 'enter this 
cycle at any point. 

The Phase Problem. 



Fig 10: The relation- 
ship between Fourier 
transforms and the 
crytallographic dif- 
fraction phase prob- 
lem. One can only 
observe the modulus 
of the complex diffrac- 
tion pattern (Fourier 
transform of the lat- 
tice) and so several al- 
ternative lattices are 
possible given one dif- 
fraction pattern. Here 
only one alternative is 
shown but others are 
possible. 
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Interactive audio... A challenge or 
companion to interactive video ? 



N A Shaw 

Footscray Institute of Technology 



In tertiary education there have recently 
been many advances, both in terms of hard- 
ware and software, in the style and applica- 
tion of new technology to the teaching 
process. This paper describes some recent 
experiences with the use of "interactive 
audio" techniques, and endeavours to 
show why this particular technology has an 
important niche in the spectrum of alterna- 
tive teaching methods. 

In addition, this paper compares interac- 
tive audio with its companion technology, 
interactive video. V/hereas both of these 
technologies have the potential to enrich 
the educational process, the special attrib- 
utes of each can only be fully appreciated 
when their appropriate role in the learning 
environment has been carefully deter- 
mined and these features matched to spe- 
cific teaching tasks. 

To provide a substantive framework 
against which to compare these two inter- 
active technologies, a context for learning is 
set by classifying both methodologies in an 
overall scheme of "intervention strategies" 
in teaching. 

Intervention strategies in teaching 

It would sometimes appear that there is a 
tendency for computer aided learning 
materials to be created with regard to the 
attributes of the technology rather than 
with reference to how and where the sys- 
tem fits into the overall educational proc- 
ess. To assist in developing an overview or 
framework, Sillitoe and Gorman (1987) 
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have adapted the Morrill Cube (after 
Morrill el al, 1974), to illustrate that any 
successful intervention in student learning 
and welfare must consider these three 
major components: 

a. the Target of the intervention strategy 

b. the Purpose of the intervention strat- 
egy, and 

c. the Methodology of the intervention. 

By using this model, the technologies of 
interactive audio and interactive video can 
be located in the spectrum of possible inter- 
vention strategies. Furthermore, each of 
the three dimensions of this model has 
several parts, allowing fuither detail to be 
appreciated during a comparative s*udy. 
This allows us to clearly illustrate the role 
and specific advantages of one technique 
over another in each situation. 

According to this classification, both inter- 
active audio and interactive video are inter- 
ventions which have the following charac- 
teristics: 

a. The target can be individual students or 
small groups of students. 

b. The purpose a can be any one of reme- 
dial or crisis intervention, preventative 
intervention, or developmental or fur- 
thering intervention. 

c. The method of intervention belongs to 
the category of educational technology. 
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By highlighting these separate elements of 
the intervention process, it is possible to 
focus upon the special characteristicsof the 
intervention strategy which most ade- 
quately address the situation. For example, 
by observing that the technologies are di- 
rected at individual students or small 
groupsof students,staffcanallowan inves- 
tigation of personal learning styles to influ- 
ence the choice of delivery mode. Pro- 
grams which are designed for delivery to a 
mass audience would not share this charac- 
teristic. 

The role of educational technology 

Within the category of "educational tech- 
nology" there is a broad range of teaching 
styles, most of which are machine depend- 
ent and require little commitment of 
human resources at the stage of actual les- 
son delivery. However, by further subdi- 
viding educational technology into the 
categories of interactive and 
non-interactive, (see Figure 1), we can 
identify those teaching styles which use 
computers for responding to student input 
and for controlling the delivery of materi- 
als, from the others. 

Figure 1: Two categories of educational 
technology. 
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Finally, within that group of educational 
tec v bogies classified above as "interac- 
tive", there is a group of techniques which 
can be represented as in Figure 2. As can be 
appreciated from this diagram, when pre- 
senting learning material to students using 
these techniques each one depends to some 
extent upon visual stimuli (use of the 
monitor), while others may also involve the 
use of audio stimuli and enhanced visual 
presentation such as full colour video. 



The following brief description identify 
the main components in this range of inter- 
active techniques: 

1. Text: The simplest style merely dis- 
plays text on the computer monitor, and 
many of the early C AL lessons operated 
at this level. The introduction of com- 
mercially available packages such as 
"Storyboard" have enhanced this style 
by offering special effects, including a 
variety of intriguing ways of wiping or 
dissolving text on the screen and a vari- 
ety of type fonts. 

2. Text and Graphics: Adding graphics, 
particularly animated graphics, to a 
text-based lesson can further improve 
the presentation of materials as well as 
increase the level of student interest and 
alertness. Perhaps the majority of CAL 
programs in education today are oper- 
ating at this level. 

3. Text, Graphics and Audio: This is the 
domain of interactive audio, where text 
and graphics (or digitized pictures) can 
be displayed on the monitor simultane- 
ously with the sound of voices, music, 
and other special sound effects. The 
added audio dimension offers great 
scope for teaching those concepts and 
skills which depend critically upon 
sound for full communication. 

4. Text, Graphics, Audio and Video: This 
part of the spectrum refers specifically 
to interactive video, where selected 
portions of video can be shown to stu- 
dents under program control. The abil- 
ity to superimpose text and graphics as 
overlays on the video as well as having 
full sound facilities, offers the CAL 
designer what appears to be the ulti- 
mate set of tools for lesson creation. 

It is important to appreciate that in the 
above discussion, components of the spec- 
trum were arranged in an order of in- 
creased degree of sophistication involved 
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in using the technologies. With progres- 
sively increased sophistication comes an 
increased degree of complexity and higher 
costs in both materials development and 
the type of peripherals needed for lesson 
delivery. Considerations of cost, effective- 
ness, preparation effort, and complexity 
are all critical elements which will be used 
later to compare interactive audio with 
interactive video. 

Having identified the range of CAL tech- 
niques available, the next step is matching 
a specific teaching task to the appropriate 
choice of educational technology. Know- 
ing the special attributes of each technol- 
ogy is most important when making a suit- 
able choice. The following section de- 
scribes interactive audio in some detail, 
identifying those special features which 
justify its place in the spectrum of interven- 
tion strategies. 

The technology of interactive audio 

Any device which can record and repro- 
duce audio information such as voice, 
music, or sound effects, and at the same 
time have all its functions controlled by a 
computer, is likely to be classified as "inter- 
active audio". A typical program can dis- 
play normal text and animated graphics on 
the computer monitor, whilst synchro- 
nized sounds are reproduced as desired. 

The method by which the audio informa- 
tion is stored may be either analogue or 
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digital. For example, an analogue tech- 
nique could be an audio tape recorder/ 
player which stores the data on normal 
audio cassette, although only a few com- 
mercially available players are capable of 
computer control. In this context, "control" 
refers to the ability of the computer to per- 
form certain tasks with the tape such as: 

• searching quickly for any desired 
position on the tape, 

• playing or recording on the tape 
whilst simultaneously monitoring 
the position, and 

• controlling the volume. 

The two common digital techniques of 
storing audio are: 

(i) compact disc, (which is laser tech- 
nology), and 

(ii) floppy or hard disc (normal mag- 
netic media). 

Similarly the sounds stored digitally on a 
floppy disc can be retrieved quickly and 
reconstituted back into high quality audio. 
Experiments have shown that recording 42 
minutes of high fidelity sound consumes 
about 10 megabytes of memory. If an 
application could tolerate lower quality 
recording, then up to nine hours of sound 
can be stored in the same 10 megabytes. 
Whatever the audio storage medium there- 
fore, an interactive audio system must have 
the ability to store and quickly retrieve such 
sounds under computer control. 
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Special attributes of interactive 
audio 

As indicated earlier, the selection of one 
style of educational technology over an- 
other is determined not only by the nature 
of the particular task in hand, but also by 
the special attributes which each style can 
offer. Too often we see one particular tech- 
nology being forced to perform a Procrus- 
tean task better suited to another teaching 
method. 

So what are the particular properties which 
make interactive audio an attractive, ad- 
vantageous alternative in certain teaching 
applications? Some of the most important 
aspects are as follows: 

a. The interactive nature of the system is 
an inherent part of any computer based 
lesson. Appropriate design of the pro- 
gram allows students to control their 
own rate of progress with the lesson, ai 
well as their own path through the 
material. This places students clearly at 
the centre of the learning process, an 
important attribute which is common to 
most CAL lessons. 

b. Audio: In cases where special sounds 
are central to the concept or skill which 
students are seeking to learn, interac- 
tive audio is particularly useful. As will 
be discussed later for example, describ- 
ing the relationship between Korotkoff 
sounds and blood pressure readings on 
a sphygmomanometer cannot be effec- 
tively conveyed without fully repro- 
ducing the genuine sounds. In addition, 
the teaching of nursing students to rec- 
ognize foetal heart beats is also greatly 
enhanced if these sounds are actually 
used as part of the lesson. Even voice 
communication itself, with the appro- 
priate emphasis and intonation, is po- 
tentially more effective than rel) nVitc on 
students to read a computer screen full 
of text. It is an emphasis on this audio 



aspect of the system which helps to set it 
apart from any other learning tech- 
nique. 

c. Visual reinforcement of the audio con- 
cepts is achieved by simultaneously 
displaying text anu graphics on the 
monitor. As the voice explains certain 
aspects of the lesson, key words (or 
whole sentences) can appear on the 
screen, thereby supporting and adding 
constructively to the learning process. 

Animated graphics can also be used to 
enhance a simulation. For example, a 
graphic representing a sphygmoma- 
nometer can be animated so that mer- 
cury in the column appears to be drop- 
ping. Whilst the "mercury" is drop- 
ping, synchronized blood pressure 
sounds are reproduced to complete a 
realistic simulation. 

With the introduction of digital scan- 
ning devices, a photograph can be cop- 
ied onto floppy disc, incorporated into 
the lesson, then later displayed on the 
monitor with additional text, graphics, 
and audio enhancements. 

d. Costs; As in any educational technol- 
ogy there are production costs involved 
with the source materials and programs 
as well as delivery costs in presenting 
the product to students. Fortunately, 
interactive audio is not an expensive 
medium in which to invest, either for 
production or delivery. Whilst interac- 
tive audio relies upon some device for 
its source of audio, whether cassette 
tape, compact disc or a digital audio 
interface, the cost of adding an appro- 
priate interface to transform a normal 
personal computer into an interactive 
audio system is less than the cost of the 
computer itself. 

e. Ease of production- Unlike some other 
new technologies such as videodisc, 
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interactive audio allows complete lec- 
turer control of the product, as well as 
requiring only a relatively short pro- 
duction time. Experience with the 
medium has shown that feedback from 
staff and students who use the program 
can be readily incorporated into the 
lesson. This can be achieved either by * (ii) 
modifying the audio tape with simple 
recording equipment, or by creating 
new digital audio files on floppy disc. 

After field trials which may involve 
further development and refinement of 
the program, the product can be con- 
verted with confidence to a permanent, 
reliable, and fast-access medium such 
as a compact disc. 

Specific examples of interactive 
audio 

The following paragraphs briefly describe 
the elements of three projects which make 
use of this technology. 



(i) 
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"Measuring Blood Pressure?' This 
program, which has been designed 
for first year student nurses, has the 
following four main parts: 

• identification of the 
Korotkoff sounds (especially 
those associated with the 
systolic and diastolic blood 
pressures). 

• reading the sphygmoma- 
nometer scale whilst listen- 
ing to the specific Korotkoff 
sounds, thereby performing 
a blood pressure measure- 
ment. 

• experiencing those mechani- ®^ 
cal factors which influence 

blood pressure readings, 
and 

• hearing a variety of 
Korotkoff sounds from 
people of different age 
groups and health status. 

22G 



At least three of these four parts 
depend extensively upon audio as 
the essential means of conveying 
information, thereby justifying this 
choice of technology over other tech- 
niques. 

"The Foetal Heart" is another inter- 
active audio program with a medical 
education theme which depends 
extensively on specially recorded 
sounds. Again the program is aimed 
at undergraduate nurses, but it is 
also appropriate as an introduction 
for students of mid-wifery courses. 
The program has three main parts: 

• locating the foetus in the 
uterus, and identifying the 
particular 'lie", 

• locating the foetal heart, us- 
ing a knowledge of the foetal 
lie in conjunction with a 
knowledge of the character- 
istic sounds created by the 
foetal heart, placenta, and 
other mother-body noises, 

• counting the foetal heart 
rate, and determining if the 
foetus is healthy. 

It will be appreciated that, for ethical 
reasons, it is not reasonable to allow 
teams of undergraduate student 
nurses to examine and prod the 
abdomen of selected pregnant 
women. However, use of this inter- 
active audio program can simulate a 
great deal of the clinical situation by 
usinggenuine sounds recorded with 
help from fully trained medical staff. 

Spelling: The third example to be 
briefly described is an interactive 
audio program designed to help 
those tertiary students who have 
significant problems with spelling. 
One technique is to read a sentence 
containing the particular word and 
at the same time display the sentence 
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on the monitor. In this example, the 
aural, visual and in-con text clues are 
all important parts of the task. One 
of the greatest problems encoun- 
tered by students is converting a 
lecturer's comments accurately into 
the written word. As can be appreci- 
ated, without an audio component 
to this basic literacy program, the 
strategy would loose much of its 
impact and relevance. . 

Criteria for selecting Interactive 
audio 

In common with most computer based 
learning projects, there is a considerable 
commitment in terms of time and resources 
in developingeach lesson. Therefore when 
academic staff submit a proposal or request 
for the development of a technology based 
lesson, considerable effort is spent on 
matching these requirements with an ap- 
propriate choice of educational technol- 
ogy, ascertaining as clearly as possible the 
learning skills involved and detailing the 
desired outcomes. 

Projects selected for development with the 
interactive audio tool have generally satis- 
fied both the above philosophy and the 
following criteria: 

1. The subject matter must have a critical 
dependence upon aural cues and spe- 
cial sounds for conveying the desied 
knowledge or skill, ensuring that only 
those projects considered "appropri- 
ate" for interactive audio are developed 
T vith this tool. 

2. Individual or small group attention is 
required to cater for a large range of 
student backgrounds and abilities. 

3. The project must be of fundamental 
importance to a curriculum offered on 
this campus. Ideally the project will be 
of value not only a large number of 



students on one campus, but hopefully 
in similar courses offered at other edu- 
cational institutions. 

The Production Team 

A successful model for the development of 
computer aided learning materials has 
been proposed by Bork (1982, 1984) and 
adopted here as the production process. In 
essence, the approach encourages the use 
of a multi-discipline team on every project, 
with the assumption that the integrated 
effect of a group of specialists contributing 
to the project will result in a better product 
than the concerted efforts of an individual. 
Authoring programs, which are designed 
to encourage any or all teaching staff to 
create their own computer aided lessons, 
tend to discourage this team approach. 

Although only a few interactive audio 
programs have so far been produced at 
Footscray Institute, already a scheme has 
evolved whereby the resources of a variety 
of people are used in the production proc- 
ess. Subject expertise is provided by the 
teacher who is ultimately responsible for 
the accuracy of the content. Special input 
comes from an instructional designer, a 
computer programmer for developing 
special effects, a script writer, graphic art- 
ist, and professionally trained voices re- 
corded in broadcast studios. 

Production time for a program is typically 
about five weeks. Howevar several proj- 
ects are concurrently being prepared and 
are all at different stages of development. 
Given appropriate conditions, it appears 
that one new program could emerge from 
the process about every 10 days. 

Evaluation 

Production of an interactive audio pro- 
gram is only one of the phases involving 
this team. Academic staff and the project 
co-ordinator are also committed to the 
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process of delivering this material to stu- 
dents, evaluating the effectiveness of the 
project, and performing any program 
maintenance recommended during the 
evaluation. The interactive audio program 
"Measuring Blood Pressure" has so far 
been field tested with a significant group of 
students (150 first year nurses), and the 
"Foetal Heart" program is still under 
evaluation. Academic staff and students 
have reported successful use of the technol- 
ogy in the strongest positive terms, and a 
few suggested improvements have since 
been incorporated into the program. 

Nine academic staff who participated in 
the evaluation phase reported the follow- 
ing observations: 

(i) The time allocated for teaching as- 
sessment of blood pressure was 
greatly reduced. 

(ii) Almost all students were able to 
identify the Korotkoff sounds re- 
quired for blood pressure measure- 
ment when taking their first blood 
pressure reading. Frustration with 
learning the concept and acquiring 
the associated motor skill was 
greatly reduced. 

(iii) Students enjoyed the interactive 
way of learning and the process 
became an interesting, non threat- 
ening way of learning an important 
psychomotor skill. 

(iv) Co-ordinating students so that they 
were able to use the program imme- 
diately prior to practice in the skills 
laboratory was difficult, due mainly 
to an insufficient number of interac- 
tive audio delivery stations. 

Student reactions to the program were also 
solicited, and almost all comments were 
extremely positive. The only negative re- 
sponse came from one mature age female 



student who stated that she "hated com- 
puters" and complained that she "felt dis- 
advantaged from her peers because of her 
lack of experience with computers". 

One class of twenty-two students was used 
as a control group in the evaluation. These 
students were asked to attend the skills 
laboratory in the traditional way, but after- 
wards were given the opportunity to use 
the interactive audio program. Comments 
from the control group covered the follow- 
ing points: 

• Some wished that they had used the 
program prior to the skills labora- 
tory. 

• Some only understood the correla- 
tion between Korotkoff sounds and 
measurement with the sphygmo- 
manometer after using the pro- 
gram, and 

• Some heard for the first time the 
Korotkoff sounds which they had 
failed to hear or recognize during 
the laboratory session. 

Since using the program with 150 student 
nurses, an additional "computer managed 
learning" component has been added. 
Each student now logs on with a unique 
identification code, and individual 
achievements with the program are re- 
corded. 

At the end of the lesson, students are in- 
vited to record their own comments. Using 
the the student's identification code, the 
tape recorder seeks a position on the tape 
which has been allocated to each student 
and the student is prompted to record 
comments for a maximum time of 60 sec- 
onds. These comments are recorded with- 
out effecting the audio tracks which con- 
tain material used in the lesson. This means 
of communication with the teacher, to- 
gether with the automatically logged 
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achievements, now provides a much more 
sophisticated way of analysing student 
reactions and performances. 

Overall, both staff and student responses to 
the interactive audio program "Measuring 
Blood Pressure" were very encouraging. 
Based on this first level of experience with 
the tool, it can be claimed that interactive 
audio is a potentially useful technology, 
particularly for teaching skills and con- 
cepts which involve some auditory stimu- 
lus. 

Comparing Interactive audio with 
Interactive Video: 

Throughout this paper reference has occa- 
sionally been made to the companion tech- 
nology, "interactive video". As a versatile, 
creative, and effective medium, videodisc 
has captured the imagination and enthusi- 
asm of people in education, training, indus- 
try and commerce in many countries 
throughout the world. Thisis an appropri- 
ate place to compare the two technologies 
according to some specific criteria. 

It should be acknowledged that each of 
these two technologies has similar but dif- 
ferent attributes, and care should be taken 
to selectively apply the appropriate tech- 
nology to the particular teaching task. In 
the discussion below, we have made a 
comparison of the two approaches assum- 
ing a hypothetical case where both appear 
to be equally suited to a given task. 

a. Costs: Interactive lideo is an ex- 
pensive technology, in terms of (i) 
the size of a production team, (ii) 
facilities and time needed for pro- 
duction, and the (iii) equipment 
needed for deliveiy of materials to 
students. It is estimated here that 
the production costs of a 12 inch 
videodisc project (involving con- 
siderable amounts of original video 
shooting) would be about 30 times 



greater than a corresponding inter- 
active audio project. 

b. Ease of maintenance and develop- 
ment: Once a videodisc has been 
pressed, its contents cannot be 
changed. If application of the disc 
in the teaching task reveals some 
design problems, the controlling 
computer program has to be re- 
vised to accommodate the error, or 
alternatively, another videodisc 
must be pressed with the errors 
corrected. 

With interactive audio, the project 
can be field-tested in the classroom 
using either analogue tape or digi- 
tal (magnetic) format for the source 
of audio. Improvements and modi- 
fications to the content can be made 
as a result of the trials, and the 
medium need only become fixed 
when the final compact disc is 
pressed. 

c. Ease of Production: The level of 
complexity of a videodisc produc- 
tion, particularly one for educa- 
tional purposes, can result in exces- 
sive lead times. For example the 
videodisc produced in South Aus- 
tralia for teaching English as a Sec- 
ond Language ('The Aussie Barbe- 
cue") has been more than 12 
months in production. Ontheother 
hand, interactive audio projects are 
considerable less complicated, and 
small production teams can de- 
velop programs within a few 
weeks. 

d. EffectivenessandappeaMfthetask 
requires the display of visual im- 
ages representing the dynamic 
real-world, then, as suggested ear- 
lier, video is the natural choice. 
However, if the task can be ade- 
quately described with computer 
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graphics (including still pictures), 
then an interactive audio program 
could be an attractive, effective and 
low-cost alternative solution. 

The learning effectiveness of each 
mode of presentation could be a 
suitable topic for future research, 
especially if such a study incorpo- 
rated an analysis of the different 
learning styles of students and the 
different modes of assimilation of 
information. 

e. Versatile applications: A videodisc 
produced for one task can be used 
under different program control for 
new purposes. This versatility of 
the medium means that greater 
value can be extracted from the 
videodisc than originally intended, 
although this "re-purposing" usu- 
ally makes us of only the visual 
material stored on disc. However, 
with interactive audio programs, 
there is less likelihood that materi- 
als produced for one program will 
be of any value or relevance to 
another. 

f. Dual Applications: When a normal 
videodisc player is used to recall 
and display a single picture or still 
frame, there is usually no associ- 
ated audio. However, if an interac- 
tive audio systemis simultaneously 
under the same program control, 
then it is possible to use natural 
voice and other sound effects to 
complement the visuals coming 
from the videodisc. 

Conclusion 

Interactive audio is an effective teaching 
process which has an appropriate place in 
the spectrum of alternative teaching meth- 
ods, and it is suggested that attention 
should be given to the special attributes of 



interactive audio which have been de- 
scribed in this paper. The examples which 
have been given from our own program 
development area illustrate how matching 
these features to specific teaching tasks can 
result in efficient and effective computer 
aided learning. 

This paper has also emphasized that sev- 
eral criteria can and should be used in 
selecting an appropriate educational tech- 
nology to apply to a specific task. Such 
selection criteria can indude the effective- 
ness of the technology and how it relates to 
the different learning styles of students, as 
well as the flexibility, versatility, simplicity 
and cost of the production processes. 

The work reported here also suggests that 
interactive audio performs well against 
most of these criteria, and represents a real 
alternative to its companion technology, 
interactive video, in a number of specific 
learning situations. Additionally, program 
designers should note that interactive 
audio and interactive video can comple- 
ment one another if a situation could bene- 
fit from simultaneous application where an 
independent, flexible audio source is used 
with stored videodisc images. 

The impact and importance of interactive 
audio in computer aided learning, espe- 
cially at tertiary level, is still to be fully 
recognized. In those instances where the 
specific attributes of interactive audio are 
matched to both the learning task and to the 
learning style of students, this technology 
is strongly recommended to educators in 
the field of computer aided learning. 
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Applications of interactive video 
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Language competency is a significant and 
growing problem amongst students at the 
Footscray Institute campus, and traditional 
methods of instruction appear to require sup- 
plementation in order that increasing numbers 
of students can be afforded the necessary assis- 
tance. This paper discusses one initiative which 
has been mounted to address this problem us- 
ing interactive video instruction. The experi- 
ences gained during the introduction and use of 
this medium on a large scale are presented 
together with some student reactions to the 
trial. 



There is a high proportion of students at 
Footscray Institute who are recent immi- 
grants. This is, in part, due to the location 
of the Institute in the western region of 
Melbourne which is a traditional settle- 
ment area, and these people naturally look 
to FIT as the major tertiary Institution in 
this region of Melbourne to provide terti- 
ary education for themselves and their 
children. Manyof these students have been 
educated to tertiary or senior secondary 
level in a non-English language, and have 
achieved a satisfactory groundingin cogni- 
tive skills such as mathematics, engineer- 
ing and science areas. However, these 
students are "underprepared" for tertiary 
education in Australia because their 
mother tongue is not English. In addition, 
other students may have had the majority 
of their secondary education in Australia, 
but live with families who have a first lan- 
guage other than English. 

As a result, there is a considerable fraction 
of our students who have difficulty in 
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appropriating the codes and nuances of 
language required of tertiary students. For 
example, many of our students have diffi- 
culties with such notions as "tone, rele- 
vance and jargon", the distinction between 
inductive and deductive argumentis rarely 
understood, and the ability to handle 
simple and complex sentence structure, 
especially for those who rate themselves as 
weaker than the average student, seems 
clearly to lie outside their language reper- 
toire. The Institute has been conscious of 
difficulties encountered by these students, 
and through ' » Institute Language Policy 
Committee, the Department of Humanities 
and the Educational Development Depart- 
ment, has been exploring a range 01 strate- 
gies to address this problem. 

As part of these initiatives, interactive 
video delivery systems acquired under a 
grant from the Commonwealth Tertiary 
Education Commission for increasing par- 
ticipation in tertiary education by disad- 
vantaged students, have been introduced 
into the regular teaching programme on a 
trial basis. Featuring the commercially 
available programme ''Writing For Re- 
sults" designed by K. Stuart and D. Limon, 
this presentation technique was integrated 
with the Written and Oral Communication 
subject taken by students of science and 
engineering. 

Interactive video systems have been the 
subject of previous seminars at this and 
other conferences. We present this paper as 
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a report of the trailing of this technique in 
our classrooms, and daiir. that this experi- 
ence has enabled a better appreciation of 
this mode of instruction to be gained by 
members of teaching staff, and has enabled 
us to observe the difficulties likely to be 
found by other educational and industrial 
organizations seeking to implement such 
computer-based instructional schemes. 

The delivery system and software. 

Hardware involved in presenting the pro- 
grammes to students consisted of a per- 
sonal (compatible) computer with hard 
disc, a video disc plaj colour monitor 
with fast blanking, and the MIC-2000 con- 
trolling interface card. This combination 
offered the facility of overlaying text and 
graphics information generated by the 
computer with video images coming from 
the video disc. Software consisted of con- 
trolling programmes (together with certain 
text and graphics overlays) stored on 
floppy or hard disc, and a set of corre- 
sponding videodiscs. 

"Writing For Results" was produced by 
Stuart and limon for the London based 
company of Interactive Information Sys- 
tems (IIS), and marketed in a PAL video 
disc format This training course is mar- 
keted as being "•••designed to help you 
write more effective business letters and 
memos". It consists of four video disc 
modules entitled "The Basics, Planning 
Your Writing, Writing with Style, and 
When the Going Gets Tough", each struc- 
tured to take approximately an hour to 
complete. These provide a comprehensive 
and sequential course, although each 
module is also self-contained. 

The educational rationale for this 
approach. 

The Humanities Department of the Insti- 
tute considered Stuart and Limon's mate- 
rial suitable for the Written and Oral G~n- 
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muni cations course since the stated objec- 
tives of the IIS course focused particularly 
on the need to: 

a* understand the basic elements of effec- 
tive writing in organizational settings, 
and 

b, apply a planned or disciplined ap- 
proach to writing. 

Clearly, in the light of our earlier comments 
regarding the background of many of the 
students at FIT, these objectives integrate 
well with the aims of a general literacy 
course at a technological institution* 

Although a student text had been previ- 
ously set for this subject, our traditional 
approach to teaching had also emphasised 
the use of "in-basket" techniques, real life 
exercises and audio-visual material to pro- 
vide authentic contexts for students work- 
ing on language development* Thus 
"Writing For Results" could be seen as a 
complement to existing curriculum materi- 
als. In addition however, interactive video 
seemed to offer us the possibility of extend- 
ing these strategies in the letter/memo 
section of the course by allowing students 
to obtain repetitive reinforcement of sound 
principles of effective writing in a collabo- 
rative context which was not unduly 
teacher-intensive* 

Consequently, it was agreed by the rele- 
vant standing Committee of the Humani- 
ties Department to use "Writing For Re- 
sults" during the first five weeks of Semes- 
ter One 1987 when students were to be 
working on an outline of communication 
theory and a unit on letters and memos. 

The design of the project 

We had initially planned that the interac- 
tive video modules would replace conven- 
tional instruction for one hour a week over 
a four-week period for a selected cohort of 
students. This proposal was contingent 
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upon suitable supervised accommodation 
for the equipment and students being 
available within the Humanities building, 
but this proved to be impossible to organise 
with relevant teaching space and staff 
being unprecedentedly loaded during 
1987. 

Furthemv>re, because of the heavy time- 
table for students in Science/E ngineering it 
became clear that it would be difficult to 
obtain sufficient free hours in a four week 
period for th - one hundred (plus) students 
to make full use of the modules outside of 
timetabled hours- Within the scheduled 
class times, even using both delivery sys- 
tems, it was evident th U a one hour time 
slot was not enough time for most students 
to work through a module. Subsequent 
experience in use of this equipment in the 
Educational Development Department at 
the Institute now indicates that most stu- 
dents take six to eight hours to use all four 
modules, even when working in small 
groups. 

With these problems in mind, end because 
of the added observation that many of the 
students seemed so keen to experience the 
material, it was decided that we would 
encourage all students to work through the 
modules. We decided that: 

a. all students in designated classes were 
to be timetabled for the use of the mate- 
rial in groupsof five while they simulta- 
neously followed the prescribed course 
of instruction, and 

b. all students were to be asked to compare 
the interactive video-based learning 
with the other mode and to complete a 
questionnaire at th£ end of the four- 
week sequence of study. 

Students involved in the project 

Initia l, 105 students were identified as 
participants in this pilot scheme. The 
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undergraduates enlisted for the trial were 
in six groups of full-time day students: five 
groups from first year Computer Technol- 
ogy and Digital Electronics and Comput- 
ing, and one group of second year students 
in Building Engineering. One further 
group of part-time evening students in the 
second year of an Occupational Health and 
Safety Associate Diploma withdrew imme- 
diately because of timetable constraints. 
However, the change in project design 
discussed above caused an added reduc- 
tion in the number of groups participating 
from seven to three, reducing the student 
population from 105 to 45. Further com- 
ment on this reduction in groups will be 
made later with the intention of highlight- 
ing some pragmatic difficulties regarding 
the introduction of new technology into 
existing discipline areas. 

Some practical considerations of the 
method of delivery. 

As with all valuable equipment, there was 
a necessary requirement for supervised 
space in which to house the interactive 
video system. In addition, we found the 
need for close supervision of some of the 
students. An attempt was made by staff to 
check with students at the beginning and 
end of each module and at regular intervals 
within the hour, which, although adding to 
the time commitment to the project, gave 
the teacher a flexible opportunity to moni- 
tor each student's grasp of the material. It 
also had the benefit of checking whether 
one student was monopolizing the key- 
board, or observing if students were work- 
ing in languages other than English con- 
trary to instructions. 

The former problem arose since the mod- 
ules were designed for individual use, and 
naturally encouraged single-user re- 
sponses. Because the majority of the stu- 
dents were in the first year of their tertiary 
course, the expectation that they should 
adapt to small group work smoothly and 
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without difficulty is perhaps a little unfair. 
In addition, the physical requirement for 
groups of students to congregate in a con- 
fined area in front of the monitor led occa- 
sionally to what one student referred to as 
a "tendency toward group larrickinism", 
requiring a certain amount of social control 
by the lecturer. 

Whereas none of these problems are spe- 
cifically due to the equipment or material 
involved in interactive video, it is neverthe- 
less an important area of consideration 
when planning the introduction of new 
techniques with large groups of relatively 
unsophisticated students. 

Reactions of staff involved in using 
the system. 

The marked reduction in participants in the 
trial from seven groups totalling 105 stu- 
dents to three groups totalling 45 students 
arose partly from the difficulties that stu- 
dents and staff experienced in organizing 
access to the equipment at times of maxi- 
mum demand. In addition, part-time staff 
were unable to continue with arrange- 
ments which took them beyond their con- 
tractual commitment to the Institute. 

We found that without technical assistance 
being continually available, simple me- 
chanical difficulties, (like running the 
wrong video disc for a chosen unit of the 
programme so that video and text failed to 
synchronize, or failing to notice loose 
leads) were a common source of embar- 
rassment for Humanities staff who were 
not familiar with electronic equipment. 
This perhaps contributed to the decision of 
some staff to withdraw .from the trial. 
While generovs technical support was 
available to t v » project, it is clear that staif 
i ntending to u^e such a system and material 
must become personally comfortable with 
the technique by having ample non-threat- 
ening opportunity to practise using the 
equipment before incorporating it into 
their classes. 



Student reaction to the use of 
interactive video 

Questionnaires were distributed to all par- 
ticipantsin the pilot scheme and complete , 
by those of the students who were still 
accessible to the project team in April/May 
during their next unit of work. The re- 
sponse rate can be seen from the following 
table: 



Course of study Number Number 
of students of 

respondents 
Building Engineering 17 11 
Computer Technology 28 21 

Total students soil 

accessible to trial 45 32 

Table 1; Accessible respondents in 
"Writing For Results" survey. 



A copy of the questionnaire is appended to 
this paper. In the questionnaire, we asked 
the studen<s to estimate how long it took 
them to work through the modules, how 
they had liked working in a small group 
and whether they had reviewed any of the 
material since finishing Unit One of the 
Written and Oral Communication Course 
(questions 1 to 5). We also sought their 
(forced) opinion of the most convenient 
location for further use of the equipment 
and their perception of the chief benefit of 
the material relative to other styles of in- 
struction, (questions 6 and 7). 

Questions 8, 9 and 10 determined the 
student's previous experience of comput- 
ing, and question 11 asked them to rate 
their own performance in English com- 
pared to their peers in the course. Finally, 
questions 12 and 13 were open questions 
which allowed the student to comment on 
what they perceived as the best and worst 
features of the the "Writing For Results" 
material. 
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The following comments were received as 
responses to the open questions 12 and 13. 
These responses are presented with the * 
reminder that only 45 out of the initial 105 
students were accessible to the project, and 
of these, 32 responses were gathered. Also, 
we should comment that the respondents 
#vere the most consistent members of their 
class in terms of both attendance and sub- 
mission of written work. 

Some of the advantages seen by stu- 
dents were: 



There was a strong preference among stu- 
dents for future location of the material in 
the audio-visual section of the library. This 
probably relates to the limited hours of 
opening of the Humanities and Educa- 
tional Development Department venues 
relative to difficulties with the students' 
timetable referred to above. For example 
during the first semester the EDD was shut 
at lunch time and after 4 pm, except by 
special arrangement. Despite this more 
than 50 students used the interactive video 
while it was housed in EDD in 1987. 



makes the person using the system more 
aware ... he pays more attention to video 
because he is interested. 

Excellent acting and production. Ideas 
clearly presented ... easy to understand. 

It was a unique and I found effective 
way of learning. 

On the whole students responded posi- 
tively to the interactive video even though 
it took them longer than an hour to work 
through each module and some had some 
misgivings about the small-group style of 
study: 

Not enough equipment (video, key- 
board) so we have to share with many 
other students and never touch the 
keyboard. 

Others found the material boring: 

After the first disc the rest became rather 
repetitive in the film and the questions 
asked. 

Most rated the material highly. Two thirds 
of the Computer Technology students said 
the material compared most favourably 
with the conventional instruction, agreeing 
that "This material gives a realistic picture 
of life in a business firm which I wouldn't 
otherwise have." (Q. 7(a)) 
O 
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Some students and staff noted the relative 
inflexibility of the IIS programme, espe- 
cially in the first module which restricted 
the exit/review possibilities. Other com- 
ments were : 

No scoring incorporated 

No questions can be asked. Need a 

general scoring result at ;he end of the 

module. 

Doesn't have a printer to print out a 
permanent copy of questions and their 
answers. 

It was common for students to have diffi- 
culty catching what they considered to be 
key details, for example the names of per- 
sons on the screen, although this might 
easily be addressed by offering users a 
scenario introduction rather than the topic 
summary which is currently supplied. 

Preliminary analysis of student 
performance. 

It is the subjective opinion of the project 
team that asaconsequenceof using Interac- 
tive Video, many weaker students made 
significant gains in language competence. 
Their grasp of the context in which formal 
written communication takes place and of 
conceptual material crucial to consciously 
increased mastery over written language 
appeared to show considerable improve- 
ment. 
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In common with the staff in the Educa- 
tional Development Department who use 
of this teaching and learning method in 
parallel Language Development work, we 
suggest that the introduction of interactive 
video into language programmes provides 
an important alternative learning focus for 
the student. This encourages student- 
centred rather than teacher-centred learn- 
ing, a central component of the culture of 
tertiary education. In addition, such mate- 
rial appears to consolidate what students 
have already learned, and when used by a 
small group, provide opportunity for use- 
ful conferencing and peer interaction. As 
indicated earlier, we should advised some 
caution in the use of this technique for 
groups of students, particularly at the 
lower level of course offering with rela- 
tively unsophisticated students. 

Interactive video was specifically designed 
for individual response, but notwithstand- 
ing the advantages increased utilization 
and the benefits of peer interaction, the 
forcing of the technique to service several 
students simultaneously needs increased 
teacher involvement and an added dimen- 
sion of sensitivity by the teacher to the 
dynamics of group interaction. 

The final point to be made in assessing 
gains by students in this trial is to note that 
for many this was an empowering expo- 
sure to new technology. A significant sub- 
group said they Md no previous experi- 
ence in computing (4 of the 21 students in 
Computer Technology and 4 of the 11 sec- 
ond year Building Engineering students) 
but were nevertheless able to complete a 
significant proportion of the course. As 
with language skills, we believe that com- 
puting skills are more adequately learned 
in a meaningful context, and the long-term 
benefits of this type of exposure to com- 
puter technology cannot be overlooked. 



Conclusion. 

The results of integrating interactive video 
material into the "Written and Oral Com- 
munications" course at the Footscray Insti- 
tute of Technology suggests that this 
method offers a useful complement to 
conventional instruction techniques. Fur- 
thermore, its use in small group settings in 
the context of classroom learning offers 
students the chance to make significant 
gains in the appreciation of new strategies 
for formal communication, and in mastery 
of the principles of formal writing. 

Two key sources of difficulty for Institu- 
tions seeking to develop the use of interac- 
tive video technology as a means of instruc- 
tion appear to be the provision of suitably 
supervised access to students, both in 
terms of location and time, and the neces- 
sity to provide effective preparation for 
those who will supervise the learning proc- 
ess. 
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CAL applications in the field of mathemat- 
ics have not been extensive; however, CAL 
techniques have been applied at different 
levels in applied sciences for some time. 
This paper focuses attention on simulation 
as an aid to understanding queuing theory. 
In courses on queuing theory, the purpose 
of this is two fold -in a purely mathemati- 
cal course, tutorial time can be more effi- 
ciently used to increase students under- 
standing of the simulation approach. Ina 
systems course more time can be spent on 
theory, with less lechire time spent on the 
practicalities of simulating queuing sys- 
tems. A basic model is presented together 
with the software design and initial imple- 
mentation on a Macintosh Plus personal 
computer* 

Queuing and queuing systems are funda- 
mental to modern civilization, and almost 
everyone has had contact with a queue at 
some point in their lives. Who hasn't been 
caught m a queue at a store or supermarket, 
and wondered if the service could be ar- 
ranged more efficiently? Unfortunately, 
queues appear to be increasing in fre- 
quency (as well as length!) and some 
knowledge of systems analysis and queu- 
ing theory is relevant to an expanding 
range of degrees and diplomas. This im- 
poses some responsibility on tertiary insti- 
tutions to provide pertinent courses on the 
subject, particularly when enrolled stu- 
dents are not majoring in mathematics or 
systems subjects. 

The teaching of queuing theory can be 
roughly categorized as either a theoretical 
mathematics approach or a systems ap- 



proach. In the mathematical approach, 
attention is usually focused on obtaining 
queuing system statistics analytically; 
simulation may be given some attention, in 
a much more minor role, than the analytical 
analysis. On the other hand, the systems 
approach usually incorporates simulations 
as the main vehicle for obtaining system 
statistics; theoretical results for some sys- 
tems may be quoted with little of the 
mathematical background given. A stu- 
dent enrolling in both types of courses 
usually receives a good grounding in most 
aspects of queuing systems. 

However, a student wishing to obtain some 
knowledge of queuing systems with a 
minimal enrolment requirement may miss 
out on a large proportion of the knowledge 
required for even a basic understanding, if 
he or she completes a course in only one of 
the above options. 

It is the intention of this paper to focus 
attention on the development of a simple 
simulation model implemented on a 
Macintosh Plus personal computer. The 
model is proposed in order to aid both 
approaches, so that more lecture time can 
be spent on simulation theory in the mathe- 
matics course, and "pure" queuing theory 
in the simulation course. In this way, it is 
hoped a student enrolling in a minimum of 
courses will receive as broad a grounding 
as possible in queuing systems. 

A Simple Queuing Model 

A large variety of simulation models and 
languages (Melamed & Morris,1985; 
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Ramakrishran & Mitra,1982) exist today, 
and it is not the intention of this work to 
attempt to develop a completely new 
model or language. Instead, a simple 
model will be used to enhance the teaching 
of some of the fundamentals of queuing 
simulation, rather than obtaining knowl- 
edge about a queuing system as the ulti- 
mate goal. Students completing a full 
course in queuing theory usually become 
proficient in the use of a model and lan- 
guage. However, time must be spent to 
gain a reasonable degree of proficiency in 
using such a system model, time spent 
learning about the model and language, 
rather than queuing. A student who is 
enrolling in a minimum of courses could 
possibly spend this time more construc- 
tively on queuing theory, both pure and 
simulation. However, the fundamentals of 
simulation must still be learnt Computer 
graphics provide a very efficient teaching 
medium(Benzon,1985) and with the profu- 
sion of such relatively cheap graphics ori- 
entated micro-computers as the Macintosh 
Plus, also a viable one. One method of 
simulating a queue manually is via a table. 
Hie number of people in the queue^urrent 
departure times, arrival times etc. are ar- 
ranged in columns, and updated as the 
simulation progresses. As noted by previ- 
ous researchers (Arganbright, 1985) elec- 
tronic spreadsheets provide an excellent 
interactive teaching medium for mathe- 
matical modelling, and a variation of this 
approach will be followed in this work. It 
has been noted (Sonenberg,1985) that 
computers are not used very extensively in 
the teaching of mathematics; this is one 
area in which computers should and can 
play a major teaching role. 

It has been the author's experience that 
students (and consequently tutors and lec- 
turers!) spend a lot of time, usually in a 
great deal of confusion, learning the very 
basics of simulation. An example is in the 
use of random numbers to simulate points 
from a given probability distribution - a 
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typical mistake is using random numbers 
more than once. Another area is in the 
simulation of service time - quite often 
students simulate service times when the 
queue is empty. The knowledge required 
to overcome mistakes such as these is very 
basic and a minimum of lecture time 
should be (and usually is) spent on it. 
However, a student must learn these 
points, and the appropriate phce is in a 
tutorial. The ease and simplicity of using a 
Macintosh Plus, makes it an obvious ve- 
hicle to use to teach students about funda- 
mentals such as these. 

The basic model will be a G/G/m queue 
(General inter arrival and service time dis- 
tributions, m servers). Although, for given 
inter arrival and service time distributions, 
this queuing system is easily simulated, 
there is no analytic solution (Kleinrock, 
1975). The simplicity of simulation will 
allow attention to be focused on the basics 
of the simulation approach, rather than 
obtaining queuing statistics from a com- 
plex problem. The features the mo del must 
incorporate are as follows: 

1. InterArrivalandServiceTimeDistribu- 
tions: A selection of analytical distribu- 
tions must be available, such as negative 
exponential, poisson, etc. As well, some 
capacity for user supplied discrete 
probability distributions in the form of 
histograms must be provided. 

2. Random Number Generation: Initially, 
random numbers are to be selected 
individually by the user, with some 
provision for automatic selection later. 

3. Error Detection and Recovery: A com- 
prehensive set of common mistakes and 
an appropriate response must be ca- 
tered for. The response must be avail- 
able at different user selected levels (e.g. 
beginner, intermediate, advanced), and 
employ the graphics capacity of the 
Macintosh Plus as much as possible. 
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4. The simulation must be presented visu- 
ally as well as in tabular form. 

5. Design should be efficient and as user 
friendly as possible, with a comprehen- 
sive help capability. 

Simulation Environment 

Initalization - the user is given the choice of 
re-activating a previous simulation ses- 
sion, or commencing a completely new 
session. At any point during execution the 
session may be saved, under a user defined 
name, or terminated. In either case a sum- 
mary of the statistics associated with the 
simulation is presented. The level of help 
must be specified as either beginner, inter- 
mediate or advanced. Beginners will be 
modelling a G/G/l queue, whereas inter- 
mediate and advanced users will be model- 
ling a G/G/n queue, and therefore must 
specify the number of servers in the queue. 
The inter-arrival/departure distributions 
may be chosen from a range of analytical 
distributions, or a discrete histogram in- 
put. In the latter case, the user is required 
to supply the appropriate step functions. 

Options - a graphic display of the queue 
during simulation is one of the main op- 
tions available, with the default being a 
tabular summary only. Breakpoints can be 
set, at which times the simulation is 
stopped, and system statistics displayed. 
The simulation can also be "stepped" 
through automatically in constant time 
increments, vith a statistical summary 
displayed at each step. Percentiles for the 
various statistics may be set, with the de- 
fault taken as 5%, giving 95% confidence 
intervals on average statistics. The default 
service order is first-in-first-out, with other 
service orders (e.g. last-in-last-out, ran- 
dom) available. The number of people 
actually in the queue initially may also be 
set, with the default taken as zero. 

Simulation - with all the parameters and 
desired options set, simulation of the queu- 



ing system can commence. A random 
number may be selected from a table, and 
used in conjunction with a graphical repre- 
sentation of the appropriate cumulative 
distribution function to simulate an inter- 
arrival/departure time. Alternatively, the 
inter-arrival/departure can be generated 
automatically from the appropriate distri- 
bution. This is then used to obtain an 
arrival/departure tme, and entered into 
the worksheet. Tlie worksheet is then 
updated to the nex'. arrival/departure. 

Error detection and help-upon detection of 
an error, the incorrect entry in the work- 
sheet is highlighted, and the state of the 
queue at the time of the error displayed. 
For instance, a departure time entered into 
a server's column when no-one is in the 
system first causes the incorrect entry to be 
highlighted. The visual display of the 
queue then shows a dotted outline of a 
person being served, indicating a nonexis- 
tent service time. A very brief error mes- 
sage is displayed, with further help an 
option. The three help options range from 
beginner to advanced, with the higher lev- 
els progressively briefer versions of the 
beginner level advice. 

Software Design 

The basic system is composed of the fol- 
lowing meta-modules, (see fig 1), I/O 
Controller, Queue Simulator, and the Hie 
system. The user interface is designed to 
make maximum use of the toolbox routines 
provided by the Macintosh operating sys- 
tem. All input and output is directed 
through a window of some form, either a 
dynamic display or a dialogue box. A facil- 
ity is provided to save a session in progress 
for resumption at a later time. 

The Queue Simulator is designed with the 
following sub-modules, (see fig. 2), Com- 
mand Processor, Simulation Controller, 
Queue Editor, and the Model Generator. 
The Command Processor handles the inter- 
action with the user through the I/O Con- 
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Figure 1 

troller, processing the various commands 
that a user may select from the various 
menus* Editing information is passed on to 
the Editor module while commands that 
concern the running of a simulation are 
passed on to the Simulation Controller. The 
Queue Editor module controls the user's 
input to the system including the entry of 
simulation data and completion of the de- 
tails at each discrete step of the queue being 
modeled. The Queue Editor gets the re- 
quired results for a specific distribution by 
extracting the appropriate formula from a 
stored library of distribution formulas. If 
parameters are required by the user, a re- 
quest is made for a valid value for each 
parameter involved. The Model Generator 
actually controls and models the present 
and previous states of the queue. The de- 
tails concerning the queue's status are kept 
in the Queue Status data sink/source. The 
Simulation Controller handles the actual 
simulation of a queue by the system for 
demonstration purposes. Commands such 
as setting breakpoints and stepping 
through the simulation are handled by the 
Simulation Controller. The current status 
of the displays and any necessary modifica- 
tions are eventually passed on to the I/O 
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Controller through the Command Proces- 
sor. 

The machine specific details are restricted 
to the I/O Controller module so that 
porting to another machine will limit the 
scope of the modifications to this module. 

Summary and Conclusions 

A basic queuing model has been presented, 
together with the software design and pre- 
liminary implementation on a Macintosh 
Plus personal computer. The model is 
aimed at assisting the learning of the funda- 
mentals of simulation techniques, particu- 
larly when the student is enrolled in a 
minimum of queuing courses. In view of 
this, the focus of the design is in the basics 
of complicated systems. The Macintosh 
Plus has a comprehensive graphics capa- 
bility, and the user friendly features have 
been exploited to provide an easy-to-use 
environment for the novice computer user. 
The simulation model is available at a vari- 
ety of levels, so that the more sophisticated 
user can avoid some of the details so neces- 
sary to the novice. 
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Figure 2 

The software is at present in the prelimi- 
nary stages of development/ and comple- 
tion and comprehensive testing with stu- 
dents is required before any detailed con- 
clusions can be drawn. However, the au- 
thors feel that the model will provide a 
valuable learning tool, particularly when 
used in conjunction with a theoretical 
course in queuing theory. The model ap- 
pears to be an ideal vehicle for applying 
CAL techniques in the field of mathemat- 
ics, and so may play a non-trivial role in this 
field. 
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Often touted as the messiah of cost-effec- 
tive training, Computer-Based Training 
(CBT) has only recently begun to deliver 
the goods. Trainers who once believed 
novice authors using simplistic authoring 
systems were capable of developing high- 
quality courseware, all at minimum cost, 
now recognize the need for experience and 
quality. Current emphasis is now placed 
on the need for instructional design and 
experienced authors for effective course- 
ware applications. This paper quantifies 
the real costs of developing a CBT solution 
from the Instructional Systems Design 
(ISD) to the actual authoring of course- 
ware. Specifically, the time and costs in- 
volved with ISD and the variations in 
courseware format are identified as major 
determinants of the overall costs of CBT 
applications. Through defining a "check- 
list" for courseware development, the 
authors provid e a guide for estimating the 
effort (time, materials and cost) required 
for producing computer- delivered train- 
ing. From a practical and experiential ba- 
sis, the conclusions of this paper are that 
CBT has and will continue to provide a 
significant cost-saving potential for train- 
ing. 

There is little doubt that microcomputer 
based quality Computer-Based Training 
(CBT) courseware is an extremely power- 
ful training medium. This is especially true 
if an organization wishes to train large 
numbers of individuals, spread over mul- 
tiple sites and the subject matter is not 
likely to be volatile. 

The issue therefore, is not whether CBT can 
survive as an effective complement to exist- 



ing forms of training, it already is quite 
successfully in many Australian organiza- 
tions. Rather, the central issue concerns the 
Quality aspect of CBT courseware. The 
essential criteria for a successful CBT strat- 
egy is not whether one has developed 
hours of CBT slowly replacing traditional 
forms of training and seemingly saving the 
organization precious dollars. What will 
determine the effectiveness of any CBT 
project is whether the training addresses 
the learning requirements of individuals 
in the field. 

CBT offers a unique characteristic com- 
pared to other forms of training, it is inter- 
active. The learner can be tested in a private 
environment without intimidation, he/she 
can practice until mastery is achieved and 
with the use of sophisticated graphics and 
animations, can be presented with highly 
effective learning strategies. If organiza- 
tions fail to meet the criteria of learning 
effectiveness, given the powerful charac- 
teristics of sophisticated interactions - CBT 
can and will be relegated to the bottom of 
the training cabinet. 

The purpose of this paper is to draw atten- 
tion to the issue of creating quality course- 
ware. In order to achieve quality course- 
ware, serious attention needs to be devoted 
to the following aspects: 

1. Instructional Systems Design (ISD) 

2. Authoring 

3. Project Management 

4. Project Personnel 
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Instructional System Design 

In undertaking any CBT project many or- 
ganizations have railed to take into account 
that before any CBT development can take 
place, an extensive analysis and design 
component is essential* Indeed the pre- 
development stage of creating quality 
courseware referred to as ISD can often 
take more effort and time than the actual 
authoring stage. As an estimate of the time 
taken to develop an hour of CBT, course- 
ware development groups consistently 
devote up to 60% o f the to tal project time in 
the ISD component 

Instructional Systems Development is not a 
new methodology, it grew out of US. De- 
fence training projects in the early 1960 / s 
(CyNeU, 1979). Since that time it has grown 
to become a highly successful and rigorous 
means by which training needs have been 
addressed for a multitude of applications. 
The distinction between design and devel- 
opment is not discussed in this piper, as the 
authors 9ee the terms as synonymous 
(Romiszowski, 1986). 

ISD has emerged in response to the press- 
ing need for a more effective, efficient and 
reliable educational system. It involves 
aspects such as task analysis, behavioural 
objectives, criterion reference testing, indi- 
vidualized instruction, formative evalu- 
ation, and media selection. While ISD was 
originally developed in the context of mili- 
tary training, if s use has spread to all 
domains of instruction and is probably the 
dominant instructional methodology ex- 
isting today. 

ISD in the CBT development cycle is syn- 
onymous to the systems analysis phase of 
any D.P. undertaking. The methodology 
serves four basic purposes: 

a) Improving learning and instruction by 
means of the problem solving and feed- 
Jj-V characteristic of the systematic 
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approach. 

b) Improving management of instruc- 
tional design and development by 
means of the monitoring and control 
functions of the systematic approach. 

c) Improving evaluation processes by 
means of the designated components 
and sequence of learning events, in- 
cluding the feedback and revision 
events, inherent in models of systematic 
instructional design. 

d) Testing or building learning or instruc- 
tional theory by means of theory-based 
design within a model of systematic 
design. 

The purpose of a systematic approach io 
instructional design is that "it encourages 
the setting of a design objective, and it 
provides a way to know when that objec- 
tive has been met" (Gagn6 & Briggs, 1974, 
p. 228). 

ISD isa proven and tested method of ensur- 
ing effective training for any CBT under- 
taking, CBT can only be effective if the 
design stage has been systematically com- 
pleted. ISD offers the opportunity to ensure 
that all the various components of the de- 
sign process have been completed and 
validated in order to maximize learning 
effectiveness. ISD will provide a detailed 
list of learning points, suggested learning 
pathways and required interactivity. The 
subject matter and training objectives are 
reassessed and the lesson is storyboarded 
in full before any authoring can commence. 

Turning to the costs consideration of 
Computer-Based Training development, 
the instructional design aspect becomes 
not only an essential ele fivent for learning 
effectiveness, but will afro ultimately de- 
termine the resource costs of the project in 
terms of time taken. In costing CBT proj- 
ects, there are certain variables ensuing 
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from the ISD stage that will ultimately af- 
fect costs and resources. These include: 



*he amount and complexity of the sub- 
ject matter 

entry level of student 
availability of subject matter expertise 
and documentation 
"system" accessibility for training de- 
velopment 

the productivity of the authoring sys- 
tem 

the instructional strategies to be em- 
ployed, i.e. simulation, tutorial, game or 
drill & practice 

the complexity of the Computer Man- 
aged Instruction, whether basic student 
management or full database integra- 
tion* 



\t is not the intention of this paper to r > - 
pand further on these cost variables. How- 
ever, it should be noted that the design 
considerations need to incorporate a de- 
tailed specification of the training require- 
ments. 

A word of caution should be noted con- 
cerning costs of quality courseware devel- 
opment If a designer wishes to employ 
complex instructional strategies with mul- 
tiple branching and implicit student mod- 
elling as the determinant of progress 
through the lesson, development times will 
ultimately increase in proportion to the 
level of complexity. 

This raises an important question concern- 
ing the differing levels of quality course- 
ware currently being used in industry. If 
business, government and industrial 
groups recognize the costs of training as the 
most important CBT selection criteria, it 
will come as no surprise that CBT course- 
ware developers need to design and de- 
velop courses cost effectively. Conse- 
quently, a compromise must be made be- 
tween instructional effectiveness and CBT 
excellence (Hitchcock, 1987). 



Constraints on development times im- 
posed by commercial realities may indeed 
limit the design process considerably. This 
is exemplified h \e low level of business 
activity with Inwiligent Tutoring Systems, 
perhaps the most advanced form of CBT. 
One of the basic impediments is that one 
hour o* intelligent instruction delivered by 
computer may take up to one year to de- 
velop, as compared to the 150-200 hours for 
the development of one hour of "tradi- 
tional" CBT using pie-determined paths 
ri\d an expository learning methodology. 
The basic steps of ISD are shown in Appen- 
dix 1. 

To conclude this section on ISD, any or- 
ganization contemplating a CBT project 
should ensure that the required ISD be- 
comes a major component of the project. 
Perhaps more importantly, the designer 
must fully understand the cost implica- 
tions of determining the detailed project 
specifications. 

Authoring 

In the field of Computer-Based Training 
(CBT), authoring is frequently given top- 
billing whenever courseware and authors 
are discussed. More often than not how- 
ever, the notions of CBT authoring are 
based on misinformed or simply incorrect 
statements describing the facilities of a 
particular authoring system or language. 
This section provides a realistic definition 
of authoring by exploding certain nyths 
surrounding authoring and detailing the 
relevant issues for commercial develop- 
ment of CBT. 

Authoring is the process of creating com- 
puter-based displays which are presented 
in an instructional sequence according to 
specified criteria. 

To be able to author, a number of prerequi- 
site steps must have been completed. First, 
an instructional event (curriculum, course 
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or lesson) must be identified, with the as- 
sumption that CBT has been validated as 
i the most appropriate delivery media. 

{ Second, this event will have been subjected 

f to Instructional Systems Development 

I processes to provide a set of sequenced 

^ instructional tasks., objective^) for each 

I task, (optional) assessment protocol for 
each objective, evaluation procedures and 

|" specification of macro and micro instruc- 

r tional strategies for the courseware itself. 

i 
I 

Third, a subject matter expert in conjunc- 
\; tion with an experienced author oroduce 
| "stoiyboards" which specify the content 
| material and interactions, linked to objec- 
; tives, which are to be displayed to the stu- 
dent. The storyboard also defines specifica- 
tions for branching and review. 

Having completed these steps, authoring 
can begin, using whatever authoring tool 
the organization has installed. With the 
widerangeof authoring took available, the 
type of courseware developed is highly 
dependent on the facilities and options 
provided by the authoring software, and 
the capability of the author to stretch the 
system beyond its documented capabili- 
ties. 

I For example, the WICAT "WISE" author- 
ing system allow s the author to generate a 
complement mode whereby graphics may 
be overlaid and the colours of the two 
graphics mixed to create a third colour. 
However, experienced authors have dis- 
covered that this mode, when combined 
with another mode, can allow the overlay- 
ing graphic to be erased from the screen 
without affecting the original graphic. Us- 
ing this teclmique can result in exceptional 
student displays. Such useof this technique 
only comes after many months of experi- 
ence with the authoring system. 

Authoring tools come in two types: author- 
ing languages and authoring systems. The 
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most commonly used authoring languages 
are Control Data's TUTOR, PILOT and 
BASIC. For authoring systems, the choice 
often seems wider than die prolific spread- 
sheet and wordprocessing packages! 

Representative of current authoring sys- 
tems are WICAT's WISE, Control Data's 
PCD3, MPTs PC Class, Compaq's Top 
Class, Microcraffs AUTHOR, Progeni's 
FORGE, Mcdonnell Douglas's AIS-II, 
AIPs COURSEMASTER, MARCONI's 
MANDARIN and Goal Systems' PHOE- 
NIX. 

Almost without exception, these products 
are marketed as being "easy to use" and 
requiring no "programming'' skills. 

However, as more and more of these sys- 
tems have been made available to the writ- 
ers for evaluation, it is apparent that there 
are two realities. 

The first reality is that all the systems allow 
authors to create graphics and text using 
similar WHAT YOU SEE IS WHAT YOU 
GET (WYSIWYG) editing procedures, and 
that the resulting displays can be linked 
into a simple sequence or branching struc- 
ture. 

The second reality is that to achieve interac- 
tive learning and full use of the media, the 
author will have to resort to programming 
concepts, if not actual programming! 

For example, one of the authoring systems 
evaluated by the writers allows the author 
to create a sequence of graphics using 
WYSIWYG editing, but then requires the 
author to text-edit an authoring language if 
any changes to the original display are 
required. In addition, any controls re- 
quired within the delivery system must be 
programmed in the authoringlanguage. In 
duect contrast with authoring systems 
which allow the author to manipulate the 
display objects on screen, this second real- 



248 



I Using Computers Intelligently 

ity highlights the the misinformation 
which is published concerning "ease of 
use" and no requirement fro programming 
'{ skills. 

!. The most appropriate method for differen- 

■ tiating authoring systems is to examine the 

\ design philosophy behind the system - and 

of course its year of release. In some in- 
I stances, authoring systems have been de- 

l signed to take minimal use of a microcom- 

\ puters options, with template screen dis- 

i plays ami limited graphic options. Con- 

jr. vereely, other systems have adopted an 

approach towards expert systems, with the 

facility to automate some of the instruc- 
' tional design logic Progeni's FORGE and 

Control Data's PCD3 are typical of this 

genre. 

Exploding the Myths 

There are two authoring myths: 

a. it is easy 

b. novice authors can create high-quality 
courseware 

Authoring is not easy. Certainly it is far 
removed from the complexities and struc- 
tures of programming languages, but it is 
not easy. A typical authoring system will 
take 4-6 months to master. Mastery implies 
the author's ability to contain the full op- 
tions of the authoring system with little ?f 
any use of manuals or help facilities. Expe- 
rienced au thors can ho we ver adap t to o ther 
authoring systems more rapidly. The writ- 
ers experience has been that a "good" au- 
thor can convert a storyboard into comput- 
erized instructional displays at the rate of 
approximately five per hour, which This 
varies according to the type of lesson and 
the authoring system used. 

It is true that the commands used to create 
display elements or objects are easy to 
learn, but the authoring of instructional 
material is a demanding task. 
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With respect to the second myth, claims 
have been made which suggest that novice 
authors have created high-quality course- 
ware in a matter of hours (Sims, 1986). 
These claims are simply false, as authoring 
systems take time to master and high-qual- 
ity courseware implies interaction. Both 
factors combined mean that effort is re- 
quired to produce such courseware. For 
example, a substantial courseware module 
will contain at least one hour of instruc- 
tional material. To create one hour of 
courseware takes from 175 to 200 hours. 
This translates to some three hours per 
minute. 

What then can novice authors create in a 
matter of hours? Some interesting displays 
perhaps, but certainly not high-quality 
courseware. 

The preceding comments have shown au- 
thoring to be a skilled task and a significant 
component of the ISD process. The follow- 
ing discussion analyses authoring in terms 
of the commercial development of compre- 
hensive, high-quality courseware pack- 
ages. 

After the ISD and storyboarding, the au- 
thor must decide on the various course- 
ware attributes. For example, courseware 
standards are essential for the consistency 
and continuity of lessons. Currently, these 
standards include a screen border with 
corporate logo and module identification 
on the top line and student control prompts 
on the bottom line. Similarly, standards 
must be defined for text colour, highlights 
etc. 

One of the most important standards to 
define is that for interaction, which is the 
essential element of successful high- qual- 
ity courseware. Questions relating to the 
number of attempts, automatic exiting and 
feedback must be resolved. For example, 
does the student continue to make a re- 
sponse to a question until correct or will the 
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judging process terminate after a specified 
number of attempts or condition has been 
reached. 

The responsibility for interaction lies in the 
storyboarding activity - it should not be 
based on a set number of text screens fol- 
lowed by a question, but rather on asking 
the learner to interact by using knowledge 
already gained. Such an approach also sig- 
nifies a move away from restrictive frame- 
based systems to more substantial, flexible 
and effective systems. 

When authors are familiar with the full 
capabilities of an authoring system, the 
interaction of the courseware will become 
the major component of the instruction, 
thereby increasing the dynamics of the 
learning experience. 

With storyboard in hand, the author can 
commence translating static displays to the 
dynamic display screen. One of the major 
flaws with many courseware packages has 
been the failure to use the graphical capa- 
bilities of the available technology. TTus 
suggests that the ISD team were not con- 
versant with the real capabilities of CBT. It 
has always been bewildering why screens 
capable of highly interactive and dynamic 
learning events have been relegated to elec- 
tronic page-turning. 

The success of CBT depends on the effec- 
tiveness of the courseware. Courseware is a 
learning product and needs to be interac- 
tive; it is not an information source which, 
if necessary, can be page-turning. 

Authoring Costs 

The cost of authoring depends on what the 
courseware entails; as each additional fea- 
ture is added the development time and 
costs increase. These features are often 
dependent on the facilities provided by the 
authoring system, and as mentioned ear- 
lier, it is cheaper ^ J more simplistic sys- 



tems which provide fewer options. As 
such, they can promote the quick develop- 
ment of courseware, but at a sacrifice for 
full use of the display screen. However, it is 
also important to keep in mind that over 
indulgence in courseware development 
should be minimized (Hitchcock, 1987), 

As each option is added, the development 
effort (ISD and storyboarding) and author- 
ing effort require more time and therefore, 
in a commercial environment, incur more 
costs. The authoring options below are 
placed sequentially in terms of ease of 
transfer from storyboard to display: 

a. Text: Normal size 

b. Text: Varied size 

c. Text: Alternate character set 

c. Text: Coloured 

d. Graphics: Circles, boxes, lines 
je. Graphics: Coloured 

f. Graphics: Rotated, sized 

g. Response Judging: Multiple Choice, 
True/False 

h. Response Judging: Short Answer (to 
256 characters) 

i. Response Judging: Student Interface 
Devices 

j. Feedback: Text 
k. Feedback: Text, graphics 
1 Feedback: Additional response judg- 
ing 

rn. Branching: Linear 
n. Branching: Student Controlled 
o. Branching: Author Controlled 
p. Animation 

q. System Variables to control display/ 

oranching logic 
r. Data Collection for student records/ 

management 
s. Student Interface Devices: Touch, light 

pen, mouse 
t. Audio and Video 

Authoring: Thefuture 

With the continual development of author- 
ing systems and the increase in microcom- 
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puter capabilities, the future of authoring is 
bright What remains is for the developers 
to incorporate all the useful technologies 
such as CAD/CAM, AJ. and Expert Sys- 
tems with current authoring systems to 
provide trainers with software that will 
assist in more efficient generation of effec- 
tive training. 

In the long run however, authoring sys- 
tems by themselves are non- productive. 
The important issue is to find the authors 
who can use them efficiently and produce 
training materials which are effective. With 
CBT courseware on hand the trainer has a 
significant training option. 

Project Management 

The role of project management is a crucial 
aspect, especially when the number of 
houi«> to develop one hour of interactive 
CBT is in the order of 170-200 hours. For the 
same reasons a DP. project would be 
managed from start to finish, CBT should 
be as carefully monitored. 

The writers have developed a checklist of 
CBT project management guidelines in 
order to facilitate the completion of course- 
ware within specified guidelines. The ex- 
perience has been that one hour of CBT 
from initial analysis to the final validation 
and field testing of the course can be 
achieved within 25-27 days. During the 
project a systematic validation is under- 
taken with the client to ensure that subject 
matter is correct and instructional strate- 
gies suit the intended audience. 

Project personnel 

Project personnel for C°T development is 
perhaps one of the most difficult aspects to 
deal with. Unfortunately there is a desper- 
ate shortage of skilled CBT personnel in 
Australia. The proof of this is that course- 
ware development organizations are con- 
stantly looking for experienced ISD spe- 



cialists and individuals that have had expe- 
rience in several authoring systems. They 
are proving difficult to find. 

Notwithstanding the present dearth of 
experienced people, the writers believe 
there are several essential ingredients to 
successful courseware developers. These 
include: computer awareness, training 
sensitivity, logical and conceptual abilities, 
customer relations, diligence and unlim- 
ited energies in order to make deadlines. 

Conclusions 

Instructional Systems Development and a 
mastery of the authoring system are essen- 
tial for high-quality courseware. Such 
courseware is not just a product of a fully- 
optioned authoring system, but the result 
of careful planning in the analysis, design, 
development, implementation and evalu- 
ation of the training material. 

With this approach, effective and relevant 
courseware is guaranteed. 
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Appendix!: Stages of 
instructional systems design 

Stage 1: Analysis 

• Task analysis and selection 

• Objectives analysis 

• Target Population analysis 

• Training and Resource analysis 

• Work Model analysis 

Stage 2: Design 

• Media selection and syllabus content 

• Course design 

• Prototype and production costing 

• Development planning 

• Management planning 

• Evaluation planning 

• Implementation planning 

StageS: Development 

• Lesson scripting 

• Lesson entry and supplemental media 
integration 

• Management system production 

• Product integration and testing 

• Supplemental media scripting 

• Supplemental media production 

Stage 4: Implementation 

• Site preparation and system personnel 
training 

• Initial data collection and testing 

• Revision 

• Turnover and acceptance 

Stage 5: Evaluation 

• Formative (pilot study) 

• Summative (after 4-6 months) 
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The use of CAL in remedial mathematics for 
economics students 
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For several ye«rs,the Department of Economics 
has been conducting a remedial mathematics 
course for first year students with little mathe- 
matical background Recently,CAL programs 
were Introduced into this course This paper 
describes how this was done and considers th e 
success of the proJecUnpartkwlar, the reactions 
of the students, the benefits to the teaching staff 
and the many spillover effects on other siudents 
in the Department are explored The perform- 
ance of the program will be judged by bekh a 
survey of students as well as consideration of 
their performance. 



Although CAL seems to be gaining more 
and more in acceptance, it seems to me that 
there are a few areas which may not have 
received sufficient attention or thought, 
especially when preparing a course. These 
include, firstly, assessment of the benefits 
and costs of such a learning program and 
secondly,the importance of targeting the 
programs to the particular group of stu- 
dents concerned.1 was also concerned to 
make sure the students had sufficient 
backup and personal contact with a lec- 
turer/tutor so that they didn't fall behind 
or have unsolved problems, without losing 
the advantages of CAL by requiring too 
much input from staff. This paper is,then, 
concerned not so much with "how to" 
conduct a lesson/course or CAL program 
but, rather, how to assess the program, and 
a discussion of factors to consider. 

CAL has been adopted only to a limited 
extent in the Department of Economics at 
the University of Adelaide.Glenys Bishop 
first introduced us to CAL and while she 
was in the Department she set up several 



teaching programs and exercise sets. Un- 
fortunately, little has been done since then, 
although we still use her programs. 

One of the subjects which seems well suited 
for a high CAL content is a first year course 
in remedial mathematics for economics 
students Alathema tics is becoming more 
and more important in the study and teach- 
ing of economics. Students with a reasona- 
bly good high school mathematics back- 
ground are reasonably well catered for 
with the option of doing mathematics in the 
Mathematics Department or in the Eco- 
nomics Department; students with an aver- 
age high school mathematics background 
generally have sufficient knowledge to 
cope with the mathematics involved in the 
core Economics subjects and no inclination 
to do any more,anyway; but students with 
very little high school mathematics were in 
a quandary.Whiie they often recognized 
their lack of skills and realized how much it 
hampered their study of economics, there 
was little they could do. This first year 
remedial course fills that gap. It is only 
open to students with very weak mathe- 
matics backgrounds and who are concur- 
rently studying or have already passed the 
first year core economics course. These are 
usually good students who are highly 
motivated and will work hard and learn 
quickly .(The less motivated student will 
often not take up this option) 

I have dwelled on the nature of this subject 
ar some length so that I can highlight the 
particular problems in teaching this course 
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| and the reasons why C AL is potentially so 

f ' successful here. First, the students do have 
I very variable backgrounds - while they 

f have had no formal mathematics education 

| in the latter part of high school, their com 

|| petence ranges from none at all to some 
familiarity with numbers and graphs etc. 
g Most of them share a deep seated fear of 

| mathematics and high anxiety over the 

§1 subject Second,they learn at vastly differ- 
^ ent speeds. Some seem to pick up the con- 
£ ' cepts very quickly whilst othersneedmuch 
j£ more reassurance, practice and time. Third, 
({; they all require their confidence to be built 
| up.Thisoftennecessitatesgivingthemalot 
f2 of practice problems that are marked by 
r £ their tutors or, less preferably, by provid- 
| v ing thsm with solutions. Fourth, they are 
£ highly motivated (as mentioned above) 

I and are prepared to work hard at the sub- 

(. ject and often undertake extra work in their 

r own time. Fifth^ince not all mathemati- 

i t cally illiterate students in the faculty 

J choose to do this course, it Ls useful to be 

? able to open up the course for any students 

I to sit in on, even if they don't formally 

I enroll. Also of relevance is the fact that we 

* seem unable to find a text book which 

covers the course in sufficient depth or 
detail and with sufficient examples and 
exercises. In addition, there is typically 
only a small number of students doing this 
course and it is a labour intensive under- 
taking. 

It L clear that CAL is ideal to meet these 
requirements - it allows the flexibility for 
students to go at their own pace, progress- 
ing rapidly over the sections they find easy 
or familiar, going slowly and/or repeating 
the sections they find difficult. Many exer- 
cises can be incorporated into the lessons, 
which the computer instantly marks and 
tells them if they were right or wrong, 
giving hin>5 as to the answer if required. 
This builds \p their confidence and also 
alerts them as soon as they don't under- 
stand a concept. 
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They are able to go back and re-use the 
lessons as often as they like, and not worry 
about being a nuisance to staff 
members,nor appearing silly to their peers 
or their tutor by always asking question, 
getting wrong answers and so on. In addi- 
tion, the lessons are available to everyone 
in the Faculty - including staff members 
wishing to give their school age children 
some extra help!! My aim, in the long run, is 
to set up all of the mathematics for econo- 
mists course as CAL modules although for 
reasons given later, I don't envisage that 
the whole course would be taught solely by 
CAL. Progress towards this aim is slow... 
especially as we are about to alter our 
Computer resources away from a VAX 
running VMS to PCs. This will necessitate 
rewriting the existing lessons and for this 
reason we have not moved quickly on 
writing new lessons. However we have 
iwo new suites about which I wish to talk. 
The first suite is a set of lessons on MATRI- 
CES; the second a set of lessons on LIMITS. 
The programming for both of these was 
done by MnTony Kiek, a programmer in 
the University Computing Centre with a 
special interest in training and education. 
We worked closely together - 1 provided a 
course outline and detailed course notes, 
Tony did the programming and any subse- 
quent changes and additions. Each pack- 
age was set up as a series of about five or six 
individual lessons, each about an hour long 
and containing explanations, examples 
and exercises.1 do not intend to give a de- 
tailed account of the content or mechanics 
of the lessons, but will point out that they 
contain provisions for going back to previ- 
ous sections,"fast forwarding" for stu- 
dents repeating the lesson and a very clever 
record keeping system. The records kept 
are the date and time the lesson was 
started,the user's name, which lesson they 
undertook, whether they finished and how 
many errors they made. The only reason for 
and use of this record keeping is in assess- 
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ing the packages - using this information 
we can determine whether any of the les- 
sons are too long, too short, too difficult, or 
have any particular problemsJ envisage 
that we will not need to continue this record 
keeping once we are entirely happy with 
the programs. In addition, we could moni- 
tor students 7 progress but this may not be 
entirely fair as the students seem to prefer 
the anonymity and privacy of the computer 
lessons, so this is not done systematically. I 
will be happy to provide more details of 
these two packages to anyone interested. 

Of interest now is the appraisal of the sys- 
tem. The amount of time spent writing 
these two packages was very considerable, 
although the second was much easier and 
quicker once we had the experience of the 
first to draw on. For a small class such as 
fids the costs of involved in tying up the 
terminals etc is negligible - at the times of 
the year when the students use these two 
packages, computer resources are reasona- 
bly slack and there is no problem in the 
students finding free terminals. The limits 
package requires a graphics terminal 
which is a constraint as many of our termi- 
nals are not graphics terminals,but this did 
not present a major problem. These are the 
costs. What of the benefits? Benefits are of 
three sorts - to the students of this particu- 
lar subject, to the staff and the wider spill- 
over effects. 

Benefits to the student 

A survey was conducted of the students to 
find out how they felt about CAL lessons in 
general and the LIMITS course in particu- 
lar. Unfortunately, because this is only a 
small class, the number of respondents was 
low (15) even though the response rate was 
high (over 75%), and so meaningful statis- 
tical analysis is impossible. One of the re- 
sults that startled me was that be/ore they 
started on the course, very few of the stu- 
dents did not like the idea of learning from 
a computer, even though few had used a 
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computer before. One or two were scared 
that they would not be able to cope, but the 
majority were excited by the challenge of 
doing some dung different. This of course 
put them on the right track for positive 
learning. After the CAL lessons, all were 
quite happy with the idea of learning from 
die computer although some indicated that 
they would not like to do all their work this 
way. There were a few particular problems 
with these lessons that caused some dissat- 
isfaction - namely that two of the lessons 
were too long. This is very important - 
although we had test run the exercises 
many times, we did not allow for the 
amount of time the students spent copying 
from the screen. This can be rectified by 
altering the lessons, giving the students a 
more accurate impression of how long each 
lesson takes and warning them to be selec- 
tive in what they write down. Many com- 
mented that the ability to take very good 
notes was an advantage of CAL lessons but 
it also took a lot of time. Specific questions 
were asked about the advantages and dis- 
advantages of CAL, as well as these par- 
ticular lessons.lt seems students see CAL as 
a useful adjunct to traditional teaching but 
do not want to lose all contact with lectur- 
ers and tutors. Five (out of fifteen) thought 
that CAL was too impersonal whereas the 
others said it was not. However all but one 
thought that the ability to work at their own 
pace was a very real ad vantage.In fact, this 
was probably the most important advan- 
tage to the students - they could work at 
there own speed, pause when they wanted 
to, go back over some of the sections and 
repeat whole lessons at a later date. Several 
students also liked the active nature of this 
learning - being forced to think about prob- 
lems on the spot, not being afraid to get the 
wrong answer,not tending to "drift off as 
you do in a lecture" and even appreciating 
the challenge of having a readily identifi- 
able task. In other words, they had some- 
thing they would start, do and finish, and 
as with an assignment,they derived satis- 
faction of completing such a defined task. 
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The disadvantages that the students cited 
were on two levels - firstly aimed at the 
particular package and its length and sec- 
ondly aimed at CAL. These perceived dis- 
advantages are important and must be 
considered carefully to ensure students 
continue to be motivated by and learn from 
CAL lessons. The major disadvantages 
students noted were; they missed the ver- 
bal explanation of, and interaction with a 
tutor/ lecturer, they found they lacked 
keyboard skills and/ or knowledge of 
computing so they often wasted time, they 
had to get used to reading, writing, typing 
and thinking at the same time, they were 
aware that it is easy to put off doing the 
session and then to find yourself behind, 
some said they often wanted to ask the 
computer questions such as "why"? or 
"what if'? 

Most of the disadvantages that the students 
mentioned can be easily solved by provid- 
ing them with more help and instructions 
before they start and ensuring that they are 
able to ask questions of the tutors and lec- 
turers. None of the students perceived the 
problem of trying to write down too much 
detail from the screens but my feeling is 
that they did this - given the opportunity, 
they tried to rewrite the entire lesson. Other 
problems that I felt arose were that they 
need to be very honest with themselvesand 
be prepared to use the lessons 
intelligently.We had one student who 
raced through the lesson in about ten min- 
utes but made 117 errors!!! 

Benefits to the staff 

In their survey responses the students indi- 
cated that they would not have liked a tutor 
in the terminal room with them while they 
did their lessons - only 4 of the 15 would 
have liked this. They did however like to 
know that help was nearby - the supervisor 
of the economics computing rooms is close 
and my office is opposite the room they 
mainly used. This means that tutors and 
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lecturers realize considerable time savings 
as we did not need to be there when the 
students were doing the work. As these 
lessons replaced all lectures and most of the 
tutorials in this topic, we were saved these 
contact hours. There was obviously less 
preparation and marking time,too.The 
students wanted some personal contact 
with their tutors so we had one tutorial on 
the topic, but I suspect that this was not 
really necessary but more due to habit. 
Against this time saving I did have several 
students call in to see me and seek help - 
certainly more than I would during a lec- 
ture course but, they were told that this was 
a new suite of lessons and that their com- 
ments were welcome, and many of their 
queries and problems caused us to alter 
and improve the wording of the lessons so 
that these problems should not arise in 
future years. On the basis of 20 students 
.and five lessons, I estimate the academic 
staff teaching the subject saved about 7 
hours of contact time and 14 hours of 
preparation and marking. 

As well as the direct time sa ving,there were 
other benefits to the staff - enjoyment, chal- 
lenge, learning new skills and so on.These 
are largely non-measurable but not insig- 
nificant. 

Spillover benefits 

There are many spillover benefit, although 
many of these may not be apparent 
initially .Certainly, the availability of these 
lessons to an audience wider than just the 
students they were written for is an impor- 
tant factor. I ran a remedial mathematics 
course for Honours Economics at the start 
of this academic year and was able to point 
potential Honours students in the direction 
of these packages. The advantage to them 
in particular is privacy and flexibility in the 
timing of these CAL lessons.In addition 
just the meagre computing knowledge that 
the students pick up from this exercise ( and 
it it is no more than being able to log on, log 
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off, and type a few characters) makes them 
feel that computers are not all that difficult 
to cope with, and probably helps them 
when they meet computing in other sub- 
jects. 

The effects on student learning 

Apart from whether students actually en- 
joy CAL or not and whether it eases the 
work load of the teaching staff, there is the 
question of whether it improves students 
learning and understanding of the 
topics, With this particular course, there are 
two aspects to the question;first whether 
the particular subject helps with their stud- 
ies in economics in general and second; 
whether CAL is better than traditional 
techniques in teaching them the required 
mathematics. The first question is not as 
relevant here as the second.With such a 
small number of students and no way of 
controlling between years, it is a difficult 
question to answer .However, my impres- 
sion is that students who had donetheCAL 
lessons understood the concepts better 
than students in previous years.Questions 
in the exam were purposely kept to a stan- 
dard very much the same as in previous 
years and the marks were higher in the 
CAL group than in previous 
years.However no firm conclusions can be 
drawn from this as too many other factors 
varied. It is at least encouraginglln 
addition^ student results are at all corre- 
lated with their enthusiasm and motiva- 
tion, then CAL should be effective. 



dents stated advantages of CAL evidence 
this. Given that most of tnc disadvantages 
cited were either of a technical nature (the 
layout of the computer rooms, length of 
lesson and so on) and can easily be fixed,it 
seems that we should try and incorporate 
more and more CAL into this subjectThere 
are three limiting factors, however.First, 
the the students do not want to be left 
entirely without personal contact and 
some, although considerably reduced, 
teaching commitment is still needed. Sec- 
ondly, the lessons must be technically well 
presented - what seems to be to the author 
of the lesson to be a triviality can become 
very important to the students (for ex- 
ample, whether upper or lower case is 
required). Thirdly, the time required to set 
up a well developed, well targeted suite of 
programs that the students will find 
interesting^hallengir.g and useful without 
being too long or too difficult piovides a 
very real constraint. 



Anne Arnold is currently Senior Tutor 
in Quantitative subjects in the Depart- 
ment of Economics, University of 
Adelaide where she teaches ntathe- 
matics and statistics, which is where 
her interest in CAL lies.Her research 
interests are in many areas of applied 
economics. 
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Summary 

The results 'of the student survey seem to 
indicate that students enjoy CAL and will 
learn from it. In fact only one student was 
not looking forward to the next suite of 
lessons and most were more favourable to 
the idea after having completed one pack- 
age than before.The particular features of 
CAL make it especially suitable for a course 
such as remedial mathematics and the stu- 
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This paper suggests that: (1) Implementation 
and acceptance of CAL should be within a dear 
understanding of the nature and purpose of 
learning in tertiary educational settings; (2) 
CAL has a unique and significant potential 
which has been constrained through a lack of 
conceptualisation and adherence to inadequate 
theory; 0) Substantial advances can be gained 
from adopting a "common code" for represent- 
ing design, implementation and learning di- 
mensions; (4) Such a coding schema could be 
developed from cumulative knowledge in the 
area of instructional design, from CAL research 
and development knowledge over the past 
twenty years and from recent developments of 
the integration of artificial intelligence and 
CAL; and (5) Theoretical, conceptual arid prac- 
tical considerations for CAL should be founded 
on the integrative research and debate in the 
evolving interdisciplinary field of Cognitive 
Science. 

This paper presents some ideas and under- 
lying principles which impinge upon 
Computer Assisted Learning (CAL) 
courseware production and its successful 
implementation i n higher levels of learning 
informal education and business/industry 
training. 

But, before proceeding to a more detailed 
discussion of CAL development problems 
it is necessary to outline some aspects of the 
role of teaching and purposes of learning in 
tertiary education into which a CAL system 
could fit. 

Articulating Learning Goals in tertiary 
education 

Given that there is (and seemingly always 
has been) substantial debate about the 



functions of tertiary education, the follow- 
ing statements will probably not be accept- 
able to all readersbut will serve as a starting 
point for discussion about the goals of any 
tertiary instructional system. 

Some of the teaching aims of post-school 
education could be thought of as providing 
a means for students: 

• To gain a meaningful understanding of 
the structure of the discipline^) being 
studied (after Ausubel, Bruner et al.) 

• To develop a knowledge base of facls, 
procedures, systems, techniques re- 
lated to the subject area 

• Toformanappredationof thehistoryof 
human effort and individual thinking 
and achievements which contribute to 
current ideas, research findings, beliefs 
and values* systems in a discipline. This 
includes intellectual processes, tools, 
methodologies and outcomes of en- 
quiry and debate which highlight 
human creativity, frustration, failure, 
chance interventions, brilliance of rea- 
soning etc. 

• To understand the meta-methodologies 
of the arts, sciences, engineering, the 
law etc. 

• To become motivated or inspired by 
creative problem solving processes in- 
cluding acquiring a value set for the 

^ ^ search for truth, beauty etc 
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• To develop general skills of criticism, 
debate, reasoned argument and skills in 
oral and written communication. 

• To develop a repertoire of knowledge/ 
skill competencies - with a number of 
particular high level performance skills 
in specialised areas. 

• To fulfil intellectual, aesthetic and so- 
cial/ moral needs and desires (for each 
individual) in a socially responsible 
way and become aware of social and 
cultural traditions and contexts. 

• Develop techniques of inquiry and 
problem solving ("research" and evalu- 
ation skills) and to undertake, manage 
and complete tasks and assignments by 
controlling, allocating and applying 
personal resources and the resources of 
the local environment. 

• To contribute to the development and 
learning of social interaction skills of 
one's self and others by interacting 
through modes of interpersonal and 
media communication. 

This 'goal lisf is by no means complete but 
merely suggests general areas of under- 
standing that learners should gain from a 
tertiary education program. The list serves 
to illustrate the points that: 

• knowledge frameworks of concepts 
that are in-filled with tacts and proce- 
dures and are central to the learning 
process; 

• we are analysing human learning and 
most (all?) goal statements have an af- 
fective component; 

• emphasis is on cognitive processes 
rather than behavioural outcomes; 

• an instructional delivery mechanism 
(human/human or human/machine) 



has to serve the above purposes in the 
first instance. That is, for example, in an 
educational setting a delivery mecha- 
nism with high entertainment value but 
low instructional purpose has little 
place; 

• any delivery mechanism must cater for 
specific needs of instruction in provid- 
ing a suitable learning environment that 
can only be truly evaluated in student 
achievement terms; 

• the mechanism for providing instruc- 
tion must be efficient in terms of the 
time required for the development 
process and the effort required for 
implementation and supervision. 

We therefore need a paradigm for instruc- 
tional research and development which 
covers educational theory for design and 
provides a suitable learning/ instruction 
computational model. 

We my conclude that our task is to select a 
framework for the formulation of a devel- 
opment environment which includes: 

• how to capture and represent content 

• how to store and deliver content 

• how to generate interaction with con- 
tent and ideas 

• how to assess the effectiveness and of 
the learning process and the efficacy 
and efficiency of the instructional deliv- 
ery system 

The computer as an instructional deliv- 
ery device 

Here I wish to emphasise the view that "the 
computer" is not just another piece of edu- 
cational technology of ihe same class as an 
overhead projector. Not only do we have 
new tools in this symbol manipulating 
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machine, which is an attribute unique to 
computers, but other aspects such as the 
speed of retrieval, access to vast amounts of 
stored information, an ability to bridge 
geographical and conceptually wide gaps 
of communication, and the ability to con- 
trol other devices singling it out as one of 
mankindsgreatest inventions. Inaddition, 
the very nature of the computer as a tool for 
intellectual modelling raises it from a 
s number manipulator to a "cognitive part- 
ner" in research, teaching and dissemina- 
tion in tertiary education. 

As various tools and processes evolve the 
creative powers of teachers in post-school 
institutions and the army of Tiuman re- 
source developers' and trainers will invari- 
ably demand new software tools for creat- 
ing educationally more complete (and 
computationally more demanding) learn- 
ing environments. There is now appearing 
a number of high quality authoring tools 
and languages, including Course of Action, 
Course Builder and Guide and the Apple 
HyperCard. But there remains a number of 
serious deficiencies which must be ad- 
dressed if we are to head towards the full 
capabilities that computers potentially of- 
fer. 

Deficiencies in Current Approaches . 

In previous papers, I referred to the process 
demands placed upon the developers of 
computer-based instruction (Barrett, 1983a 
'83b, '83c, '86a, '8bb). These papers analyse 
design and implementation variables and 
constraints in courseware authoring. Ap- 
proaches to CAL implementation gener- 
ally fall into one, or a mixture, of the follow- 
ing categories and scenarios of usage in 
tertiary settings: 

1 Application Tools. Take an application 
package such as a word processing or 
statistical package and incorporate it in 
the classroom with as little adjustment 
as possible to the curricula. 

O 



2. Problem Solving and ModellingTools. Go 
a step further than (1) above and de- 
velop models of the problem solving 
approaches employing these new cog- 
nitive modelling tools. 

3. Packaged CAL. Use someone else's 
courseware, commercial or otherwise 
and readjust the curriculum around 
whatever is available. 

4. Local CAL development — "The Cottage 
Industry Model". Employ whatever 
skills are available from those (or that 
person) in the area(s) of instructional 
tecnniques, curriculum representation 
(subject area content), graphics design 
and coding on computer (program- 
ming/ authoring) 

5. CAL — "R & D Centre Model". Full de- 
velopment tools and resources in a 
managed organisation. This category is 
very rare in tertiary education in Aus- 
tralia but a niche of rapid growth in the 
commercial world. 

Deficiencies in any of the above develop- 
ment environments include: 

• appropriateness of the specific course- 
ware 

• application developers knowledge (or 
lack of it) 

• development tools capabilities 

• project management skills and support 
resources 

• financial support, encouragement, rec- 
ognition for outcomes. 

Again I contend (see Barrrett 1983c and 
1986b) that significant advances in the 
widespread use of CAL in Tertiary Educa- 
tion will come about through the develop- 
ment of more appropriate development 
tooL, the building of a cumulative library 
of an accessible resource base and con- 
certed effort in an efficient CAL production 
centre and conducted on modern business 
grounds. 
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The underlying problem of CAL 
development 

The underlying difficulties facing JAL 
development and its infiltration into the 
educational system (beyond financial con- 
siderations) is a lack of agreement on the 
"superstructure" or subject matter of the 
CAL development enterprise. By this I 
mean there is no universal agreement of the 
nature of the instructional enterprise or its 
pa**icular underlying coding mechanism. 
This position has arisen mainly because: 

• learning research was forced into a 
backwater on the tide of behaviourism. 
The whole approach has been shown to 
be devoid of any substantial contribu- 
tion and should be relegated to its 
proper place with the 'learning" of 
lower oflder "reflexive" skills. 

• the principles and research findings 
relating to Adult Learning have, in 
almost every case, been ignored 

• delivery mechanisms have been mode- 
led on the mechanical teaching ma- 
chines and similar media. As previ- 
ously stated this has restricted us to a 
limited metaphor blinding us to what is 
possible with an entirely different per- 
spective 

• there are at least three diverse forces 
which influence CAL development and 
the techniques, tools and philosophies 
from each has marked influence on the 
finished product - 

1. educational/ learning dimension 
which operationally encompasses 
the design of instruction. A vast in- 
formation base has evolved from 
research on leanvng and instruction 
which should be the basis of any 
courseware development 

2. the computational dimension which 
operationally defines the instruc- 



tional p.ocess and evolves a ma- 
chine environment for the delivery 
of designed instruction or provides 
tools for learner controlled explora- 
tions 

3. media dimensions — from influ- 
ences of graphics design, visual 
media specialists or communication 
experts. 

For too long, many CAL developments 
have been dominated by the author's our 
own area of interest or expertise to the 
exclusion of one or more of the other ele- 
ments vital to a success courseware pro- 
duction. It is extremely rare that a develop- 
ment environment contains a person or 
team having the right mix of educational, 
computing and media/communications 
expertise. 

More importantly, however, development 
tools haveprovided little positiveguidance 
for the integration of the distinctive phases 
of the interpretation of initial ideas through 
design, layout, coding, testing and evalu- 
ation. Most instructional developers, and 
probably most teachers remain alienated 
from CAL because of the lack of easy access 
to either development environments (and 
tools) or an inability to make changes to 
courseware that is only "nearly" suitable 
for their particular classroom application. 

In a similar vain, a distinction remains be- 
tween tools available to designers and tools 
available to learners in a run time version of 
the courseware. Learners often have a 
much more restricted environment during 
a CAL lesson. Often, developers have 
commented that they "really got to know 
the subject area after wrestling with struc- 
ture and content or 'programming dimen- 
sions" but then they only pass on to the 
learner a constrained path with virtually no 
"freedom to learn"! 

Through computer accessibility and their 
pervasiveness in all walks of life it is not 
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surprising that a whole host of forces have 
motivated a diversity of people to develop 
CAL courseware. Some goals have been 
more commercial than educational, some 
processes more computing concerns than 
instructional goals, and many outcomes 
amateur rather than professional. They are 
moreof ten conducted as "back-yard" (read 
"isolated campus") activities rather than 
processes of modern production centres. 

There is an even greater problem than lack 
of purpose and lack of co-ordinated re- 
search and development effort and this 
concerns a lack of conceptualisation which 
is taken up in the section that follows. 

Devising a CAL metaphor 

Many of man'*? greatest achievements have 
been built on a dream - a vision. The use of 
a suitable metaphor provides not only the 
visual imagery and emotional stimulus but 
also provides a concrete framework on 
which to hang our ideas. Many people 
know of the chalkboard matrix that gave 
rise to the Spreedsheet metaphor and the 
production of Visicalc. Similarly, the "desk 
top" metaphor ha: been carried over from 
Smalltalk to the Ap h le Macintosh, Com- 
modore Amiga and Atari machines. 

More recently a team of "stood down" 
workers from a Seattle newspaper set out 
on a market research tour of Washington 
a^i Oregon with the genera, notion of sell- 
ing the idea of producing advertising ^upy 
on microcomputer at newspaper offices. 
But, in a moment of discussion the four 
particiants had concurrent insight into the 
underlying problem they faced. It was not 
newspapers that had the "need" for collat- 
ing advertising materials - they already 
had the process, however backward- but 
what if individuals had access to such 
tools? Mr Paul Brainerd, a journalist with a 
long standing interest in computers, real- 
ised the goal was to provide the general 
populace with full professional publishing 
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facilities. The metaphor of "desk-top pub- 
lishing'' was realised and the idea material- 
ised as PageMaker from the now highly 
successful Aldus Corporation (Talevich, 
1987). 

The point here is that we in tertiary educa- 
tion need to be very clear of our goals and 
purposes to come up vrith a suitably vi- 
sioned tool that will help us achieve our 
goals. 

I believe that current CAL is still based in 
the book metaphor, with a foundation in 
verbal material and text. Developers and 
learners need more of a visual base and a 
suitable metaphor. One suggestion could 
be a 'space exploration metaphor*. This al- 
ludes tc a 'universe of knowledge' which is 
to be explored and mapped. It includes the 
idea of various systems (disciplines) and 
sub-systems (fields) which require explo- 
ration and 'documentation' (understand- 
ing). Jn this metaphor the CAL software 
acts as an electronic guidance system for 
the journey of exploring new knowledge. 

However, there is a far greater and more 
fundamental deficiency. What we need is a 
universal code of symbolic representations 
which will assist us in recording the map of 
a knowledge universe. And we need this 
NOT to alter the knowledge structure of the 
discipline into some phony or forced cod- 
ing systeir but to provide the most efficient 
means of synthesising materials into a for- 
mulation for natural learning experiences 
and its producing the documentation. This 
can only be achieved through an agreed 
upon analysis and classification system 
having its unique nomenclature and in- 
structional/ learning coding system. Our 
goal then should be to develop a common 
code for learning environments, with spe- 
cial attention to computer-based learning. 
The representative code should condense 
or provide a "shorthand" representation of 
the know xige, procedures, skills etc. 
making up a discipline or sub-disciplinary 
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area. The code should provide a means of 
cuing the various instructional delivery 
modes, media and interaction processes. 

In search of the Common Code 

One could hardly imagine developments 
in, for example, the arts, engineering or 
science without the existence if an underly- 
ing code - possibly mathematics! Similarly, 
agreed standard codes for manufacturing 
design and production are essential. Even 
the computer industry with numerous 
"standards" has many common underly- 
ing coding schemas. But, something as 
important as education - specifically in- 
structional design and 'learning products" 
is conspicuously lacking conceptual agree- 
ment or functional commonalty in respect 
of representing the teaching/ learning 
process. We are in a situation which would 
be as crazy au each <iraf tsperson producing 
building designs with no agreed upon 
symbols or means of expressing specifica- 
tions. This is even more disastrous when 
we examine current practice in CAL pro- 
duction. 

The overall problem of CAL development 
becomes clear if we briefly examine the 
current process of authoring CAL materi- 
als. This could be labeled bottom-up, ato- 
mistic approach and well entrenched in 
behavioural methodologies. The 'mechan- 
ics' of structuring objectives, formulating 
modules and sub-sections and the very 
development process from the parts-to- 
the-whole encourages a 'dis-integrated' 
product. More importantly, the "produc- 
tion system" is devoid of any universality 
in its coding process or its documentation. 
But it becomes impossible to compare the 
design, learning processes and possible 
cognitive outcomes unless there exists 
some type of common coding system. 

It should be possible create a system which 
is theoretical!) ^und, na* universal agree- 
ment at the coding level and which has 



practical attributes of natural ease of use 
and management. The common code rep- 
resenting instructional content and proc- 
esses essentially represents the layers of - 

• the learner's cognitive processes 

• activities and processes in the learning 
environment 

• the intentions and operational instan- 
tiations of the author/ instructor 

Building a code 

The type of coding system suggested in this 
paper should be built upon three main 
foundation areas. 

First is the accumulated knowledge of in- 
structional design systems technology 
epitomised by the work of Romizowski 
(1984, 1985) . Although, as mentioned ear- 
lier, much of this work is based on behav- 
ioural psychology there is a wealth of syn- 
thesised material from systems research 
which can be balanced by content and 
procedures from the two areas that follow. 

Second, we should take into account the 
vastamountof informationbuiltup fromat 
least twenty yearsof research and develop- 
ment of computer-based learning systems. 
These areasof expertise need careful evalu- 
ation in order to identify what really works. 
(See for example the work of Baker, 1978; 
McCann.1981; Rushby,1981,0'Shea,19e3; 
Steinberg, 1984; Kearsley, 1987; Merrill, 
1985 and 1987; Deer, 1987). 

Third, the CAL coding taxonomy should 
by based on a firm conceptual, theoretical 
and computational footing derived from 
the evolving discipline of Cognitive Sci- 
ence. This new interdisciplinary field 
brings together debate, research develop- 
ment from Cognitive Psychology, Linguis- 
tics, Computer Science (Artificial Intelli- 
gence), Neuroscience and Philosophy. 
Many of the theoretical and practical prob- 
lems faced in these disciplines are directly 
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related to such areas as knowledge repre- 
sentation, problem solving and machine 
configuration and especially human learn- 
ing that they form the very conceptual rock 
on which a new science of instruction can 
begin to built. (See, for example, the writ- 
ings of Anderson, 1980; Gardner, 1986; 
Levine. and Rheingold, 1987; .Minsky, 
1986). 

But what central areas, or design content, 
should the proposed code encompass? The 
cognitive elements which must be covered 
in detail are (at least): 

• language -in general and the jargon of a 
content field or discipline 

• perception, attention and visual im- 
agery 

• numerical and computational elements 

• knowledge structured), representation 
and memory 

• cognitive strategies in learning 

• reasoning and problem solving strate- 
gies and development of expertise 

• cognitive development requirements 

• psychology of motor performance (as 
related to competency). 

It is readily observed that the above factors 
are highly weighted in the cognitive do- 
main am* suggest a coding mechanism 
which represents aspects of cognition 
rather than such 'traditional' dimensions 
as behavioural objectives, frame sequenc- 
ing or reinforcement. However, while not 
excluding affective or cultural influences 
or interventions in cognitive performance, 
these are not the primary focus of this 
approach. The coding schema should first 
and foremost reflect the cognitive proc- 
esses taking place in the mind of the learner 
ashe or she interacts with content mediated 
by the delivery system. In operation the 
suggested representative code has to serve 
three masters - representing the content of 
the discipline, becoming the stored and 
transmitted code of the CAL delivery sys- 
tem and being a representation of the stu- 
dents learning. Attempts have been made 
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to include these dimensions in modern 
Intelligent CAL systems but without the 
benefits a common code would offer. 

The ideas expressed here may be consid- 
ered in terms of a music analogy; the musi- 
cal notation represents, at various times, 
the ideas of the composer, sequential and 
propositional instructions to the 
musician(s), 'control structures' to conduc- 
tors, psycho-motor commands to players, 
music to the audience and sound/ visual/ 
aesthetic images and experiences to the 
individual listener - all by means of a work- 
able coding process for recording, storage, 
retrieval and presentation and reception. 

Like music, our instructional ideas and 
content needs to be represented not only 
for the idea they 'contain' but how they are 
to be delivered, ie. on what "instrument" or 
.audio/ visual mode or media. Similarly, 
the instructional "conceit" must be "or- 
chestrated" and delivered in such a way 
that makes the whole experience worth- 
while in light of the criteria of the com- 
poser/ author, conductor/ teacher and 
listener/ learner. 

It should be noted that, even if there are 
some "intermediate" processes the coding 
mechanism either holds true to the original 
authors intentions or, at least, allows a 
range of variations and interpretations by 
later conductors and musicians or record- 
ing engineers. That is, for example, record- 
ing sessions by different cultural groups 
under different condi tions allow local vari- 
ations while still preserving much of the 
original ideas. For instruction, provided 
the original ideas and content are 'classical' 
they can be preserved and delivered in 
more modern modes or styles but still 
convey the original content. 

Development processes and the delivery system 

The suggested common code approach 
provides a number of practical advantages 
to instruction: 
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• Accumulated resources and delivery con- 
trol or access. The "common code" ap- 
proach not only provides a common 
mechanism of understanding the struc- 
ture and deliver specifications of con- 
tent over disciplines and across time/ 
space barriers, it encourages the pool- 
ing of resources on a national and inter- 
national basis. It provides an efficient 
means of authors identifying or analys- 
ing their own, or others, instructional 
materials. More importantly, classifica- 
tion of vast amounts of material such as 
that appearing on CD ROM (for ex- 
ampl e the Microsofts "Bookshelf refer- 
ence works - there are now more than 
150 CD ROM applications) will prove 
invaluable to instructional designers 
and instructors. 

• Templates. Similarly, templates of accu- 
mulated resources on an international 
basis will advance the implementation 
and quality of instructional/ learning 
resources. With the appropriate imple- 
mentation tools (application 'front 
ends', CAL shells, designers toolkits, 
instructional "sub-assemblies" etc) lec- 
turers and instructors should be able to 
concentrate on the quality of subject- 
matter content aid cognitive processes 
of the learner which should be now 
feasible for any "student model" will be 
constructed in the same underlying 
code. 

• A New Authoring Process. But, given the 
intricacies of the task and the seeming , 
complexity of any coding schema, how 
can we possibly hope to author even a 
ten minute sequence of cognitive learn- 
ing? The same could be said if we were 
about to embark on a new thing called 
music! The answer is virtually opposite 
to most CAL authoring. The process 
suggested here involves working from 
the "big picture", top-down perspec- 



tive. The author would begin by writ- 
ing, or capturing the essence of the 
content as a natural language narrative. 
The next step is to bring this into instruc- 
tional code by use of a 'Tool for Instruc- 
tional Editing" (TIE). The author would 
go through each paragraph by use of the 
instructional editor marking out defer- 
entially all the "instructional units" and 
control structures which would be 
translated into coding symbols like 
musical notation. It is the wholistic 
script which holds the key to continuity 
and integration. If the script is altered, 
similar to an ideas outliner (such as 
Think Tank), the text will change place 
but the underlying structure and repre- 
sentation will remain unaltered but 
transposed. 

The TEE allows for the analysis of content in 
terms of structure of the content with re- 
gard to facts, concepts, principles, rules 
and propositional organisation, proce- 
dural knowledge etc; of instructional vari- 
ables such as number and type of examples, 
pacing, questions/ answers, etc; of learner 
cognitive variables such as memory en cod- 
ing prompts, consolidation processing ac- 
tivity, reasoning processing etc. The TIE 
will also be capable of orchestrating deliv- 
ery modes. This is an "authoring front- 
end" which assists in the Instructional 
Design process and, more importantly, 
"generates" the underlying code in 'cogni- 
tive units'. 

Overall, the common code approach will 
encourage the integration of learning 
through coding which relates to "natural 
language". Thus, this form of authoring 
will pave the way, or integrate with, devel- 
opments in intelligent CAL programs. Its 
main strength ether than practical consid- 
erations, is that it is founded on cognition 
(thought) rather than behavioural manifes- 
tations. 



ERLC 



<j o 5 



256 



Using Computers Intelligently 



References 

Anderson, J.R. (1980). Cognitive Psychology 
and its implications. New York: W.H. 
Ireeman & Co. 

Baker, F.B. (1978). Computer Managed In- 
struction: Theory and Practice. Engle- 
wood Cliffs, N.J.: Educational Technol- 
ogy Publications. 

Barrett, J.B. (1983a). Instructional Demands 
for Computer Based Learning. 2nd Aus- 
tralian Computer Education Confer- 
ence, Melbourne. 

Barrett, J.F. (1983b). Computer-Based Learn- 
ing: Constraints onDevelopment. Annual 
Conference of NSW Computer Educa- 
tion Group. 

Barrett, J.F. (1983c). Designing Computer 
Based Learning in Tertiary Education - 
Requirements and Realities. Computer 
Assisted Learning in Tertiary Educa- 
tion, Brisbane. 

Barrett, J.F. (1986a). Student Model in Intelli- 
gent Computer Assisted Learning. Pro- 
ceedings of the 17th Annual Australian 
Colleges of Advanced Education Com- 
puting Conference (p.102). 

Barrett, J.F. (1986b). Towards Specifications 
for Intelligent CAL. 1st Australian Artifi- 
cial Intelligence Congress, Melbourne. 

Deer,B.L. (1987). Aland The Authoring Proc- 
ess. IEEE Expert, Summer. 

Gardner, H. (1 985). The Mind's New Science. 
New York: Basic Books. 

Kearsley, G.P. (Ed) (1987). Artificial Intelli- 
gence and Instruction - Applications and 
Methods. Boston: Addison-Wesley 
Publishing Company, Inc. 

Levine, H. and Rheingold, H. (1987). The 
Cognitive Connection. New York: Pren- 
tice-Hall. 

Merrill, M.D. (1985). Where Is The Author- 
ing In Authoring Systems? / ournal of 
Computer-Based Instruction, 22(4), 90-96. 

Merrill, M.D. (1987). An Expert System for 
Instructional Design. IEEE Expert, Sum- 
mer. 

Minsky, M. (1986). The Society of The Mind. 
New York: Sinv;n and Schuster. 



McCann, P.H. (1981). Learning strategies 
and computer based instruction. Com- 
puters and Education, 5, 131-140. 

CShea, T. and Self, J. (1983). Learning and 
Teaching with Computers. Englewood 
Cliffs, N.J.: Prentice-Hall. 

Rushby, N.J. (Ed) (1981). Selected Readings 
in Computer-Based Learning. London: 
Kogan Page. 

Steinberg, E.R. (1984). Teaching Computers 
to Teach. London: Lawrence Erlbaum 
Associates. 

Talevich, T. (1987) Paul Brainer 70: The 
Wizard of Aldus. Old Oregon, University 
of Oregon, 41. 

Software Discussed 

Bookshelf Microsoft, Australia. 
Course Builder. TeleRobotics International 
Inc., 8410 Oak Ridge Highway, Kn- 
. oxvine,TN37931. 

Course of Action. Authorware Inc., 8621 
Pine Hill Road, Bloomington, Minne- 
sota 55438. 

Guide. OWL International Inc., 14218 
Northeast 21st Street, Bellevue, WA 
98007. 

HyperCard. Apple Computer Australia. 



John Barrett is a Lecturer in Educa- 
tion at Macquarie University. His 
research and development interests 
are in the psychological aspects the 
use of computers for learning in 
education and training. He first 
became involved in computers in 
psychology and education at the 
University of Oregon in the early 
1970 / s, graduating with a PhD He is 
currently chairman of the Apple 
Education Foundation and a mem- 
ber of the initial executive commit- 
tee of ASCILITE. 



GG 



Computer Assisted Learning and the future 
of education 



Brian WCarss 

University of Queensland. 



Thi changing nature of educational technology 
is towards a digital electronic environment, 
away from the present multiplicity of hardware. 
This change is expected to be completed within 
the next decade. The challenge that faces educa- 
tional institutions during this period of change, 
is how to exploit the advantages that the new 
media offer and at the same time, enable aca- 
demic staff to fed sufficiently ccmfortable with 
it, to want to use it A "most likely" future is 
described and the implications of this to educa- 
tion are discussed 



This paper describes a research project 
which was carried out to determine what 
developments were likely in information 
technology and how would these develop- 
ments effect education at the tertiary level. 
A Delphi survey was carried out with most 
of the major electronic equipment manu- 
facturers being the principal respondents. 
The most striking finding of this survey 
was to confirm the rapid move away from 
film and analogue magnetic recording 
media to all electronic digital equipment. 
The research project was carried out in a 
number of specific phases. Phases 1 and 2 
were devoted to a world-based Delphi 
study (Linstone, Turof f 1975) of media and 
educational technologists, designers and 
publishers wifh the specific aim of deter- 
mining the state of educational technology 
by the year 2000 A.D. 

Phase 3 was used to develop possible alter- 
native future scenarios which incorporated 
the technological possibilities isolated 
during the first two phases. Some of these 
scenarios represent extremes in ~n educa- 



tional continuum, and none of the pro- 
posed futures were seen as likely to evolve 
in a pure form. The most likely future will 
almost certainly be a weighted combina- 
tion of the five scenarios. 

During phase4 of the project, two panelsof 
senior educational professionals and prac- 
titioners engaged in a series of priority- 
setting sessions in an attempt to develop a 
set of weightings of influences on pre-terti- 
ary and tertiary education in Australia for 
each of the scenarios. 

The 5th and final phase was directed at 
developing a most likely composite sce- 
nario for education 2000 A.D. Details of 
procedures followed in the Delphi study, 
priority-setting sessions and the derivation 
of the composite scenario are described in 
Morris (1985). The resultsofthefinal phase 
only are presented. 

Composite Scenario 

Academic staff will still operate in 2000 
A.D. in much the same way that they do 
now, but in a somewhat different style from 
thai of the WoWs. Education will have 
become appreciably more sensitive to tech- 
nological change by that time. Yhe most 
significant change will be on the quality of 
education and the techniques used, 
brought about by the advances in technol- 
ogy. 

By the year 2000 A.D., Society will be both 
dependent upon and dominated by, Infor- 
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mation Technology (Goldsworlh/.1980). 
Education being totally committed to the 
new technologies and their availability, 
will be equally totally dependent on and 
susceptible to the changes in technology 
itself. 

There will be a strong growth in the accep- 
tance of education as being a life long activ- 
ity, with the consequent life-long demand 
for facilities, resources and opportunities. 
Because of the huge costs involved in the 
constant turnover of the latest technologi- 
cal advances, the institution will have to 
accept more responsibility for the provi- 
sion of centrally produces programmes 
and resources of hardware and software. 
There will be a corresponding decrease in 
the individualistic approach to teaching. 

Institutions 

Institutions will have changed in that it will 
no longer be necessary for students to be on 
campus and attend formal lectures. Stu- 
dents may be required from time to time to 
attend specific lectures or participate in 
small group seminars but for the most part, 
students will rely on gaining access to the 
information resources they need through a 
highly sophisticated communications net- 
work which will enable them to work from 
their homes. 

There will be increased governmental 
intervention into education in an attempt 
to link closely the products of the formal 
education system to societal demands foi 
increased sophistication in its workforce. 
So too, will there be a need to increase the 
quality of instruction. This will lead to the 
employment of teams of specialists in cur - 
riculum design and development, commu- 
nication and evaluation. 

There will be an identifiable increase in the 
influence on the curriculum of multina- 
tional and international corporations in- 
volved in the production of hardware and 



software. Such companies will exert pres- 
sure both overtly, through their products 
having been given an "international fla- 
vour'', and covertly, through pressures 
exerted by the way of the "fashion" phe- 
nomenon operating through the cultural, 
entertainment and recreational needs of 
people in the workforce. 

Students 

Students are not seen as having a great deal 
of influence on educational decision-mak- 
ing. They will have a greater choice in the 
range of course offerings a\ ailable to them 
but this will be matched by the increase in 
what is regarded as "core" material, dic- 
tated by a central authority intent on deter- 
mining minimum standards of perform- 
ance. 

-Lecturers 

The changes for lecturers will be greater 
than those experienced by students. Most 
importantly, there will be an overall loss of 
prestige. Although the freedom to choose 
teaching strategies will be greater because 
of the greater range of techniques available, 
their influence on what is taught will be 
reduced. In other words, they will have less 
say in what iy taught but more latitude on 
how to teach it. 

A noticeable change that will have 
emerged will be the reduction in job secu- 
rity of academic staff. Increasing financial 
constraints will cause the Government as 
the funding agency, and the University as 
the employing agency to challenge the 
concept of tenure. 

Instructional Designers and Other 
Specialists. 

The increase in specialist influence on 
learning and teaching techniques will be 
profound. The control and dissemination 
of information will have become a highly 
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specialized activity. Education will have 
adopted the "medical" model where each 
new development results in the emergence 
or retraining of specialists in the innova- 
tion. Educational specialization will range 
from Communications and information 
technology through curriculum design, 
monitoring and remedial specialities to 
those of the diagnostic and clinical educa- 
tional physician. 

There will be an increase in the production 
of one-way distributed media. It should be 
remembered that books, journals and all 
hardcopy materials fall into this category, 
as do films. As these new materials will be 
made available through the multipurpose 
media communication terminal, there is 
the opportunity for central control (censor- 
ship) to be applied. 

A surprising growth area will be in the area 
of lecture room media. Despite a concern 
with the individual, large groups operating 
within lecture theatres will still be seen as 
appropriate for some kinds of learning. 
The cost of optical film-based materials will 
have increased to such an extent that digital 
electronic solutions will be sought using 
tape or disc. Long-life laser and digital 
technology, together with optical fibre 
transmission will see high quality audio 
visual distribution for display on large 
screensin lecture theatres. There will be an 
added dimension of interactivity brought 
to theatre presentations thereby upgrading 
the quality of instruction. 

It is unlikely that the optical video disc will 
have a great impact on education because 
the cost of production and the specialized 
equipment needed for the manufacture of 
the discs. Thus education generally, will 
become increasingly a system which will 
use the latest information technologies 
supported by highly trained specialists in 
their application. 



Implications of this Scenario for 
Teaching 

To reiterate the implications of these tech- 
nological developments, the complexity 
and sophistication of the new technology 
will require that it be handled by special- 
ists. Specialists not only in the use of the 
hardware, bu t also specialists in the educa- 
tional exploitation of the capabilities of the 
hardware. 

Few tertiary institutions in Australia ap- 
pear to have recognized the need to pro- 
duce specialists in instructional design as 
being important for their inevitable fu- 
tures. Concer for the development of 
CAL in a few institutions is in response to 
economic pressures which are present. It is 
hoped that by adopting CAL as a teaching 
medium, the institution can avoid increas- 
ing its staff to cope with the increasing 
numbers of students seeking tertiary edu- 
cation. 

Several universities are experiencing a 
"blow out" in student enrolments in the 
Social Sciences particularly in Commerce 
and Economics. At the University of 
Queensland in the Faculty of Commerce 
and Economics the use of computer man- 
aged learning techniques (CML) is a large 
enrolment (700) introductory financial ac- 
counting subject has made it possible to 
more than halve the number of tutorial 
assistants needed as well as reduce the 
number of academic staff from three to one. 
This has been achieved without any reduc- 
tion in the quality of instruction. It has 
however, placed very high demands on the 
academic staff in having to master the tech- 
nology as well as be concerned about the 
restructuring of the course content. The use 
of CML demanded a restructuring of the 
subject as well as the creation of a sizeable 
database of test items. The items in the 
database had to be carefully linked to the 
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specific objectives of the course. These 
were tasks that took many hours of aca- 
demic staff time to complete. 

The r lajor impact of the use of CAL in this 
way 'has drawn attention to the need for 
staff development. Staff development in 
the use of CAL cannot be confined to learn- 
ing of an authoring language or authoring 
system, but must also include developing a 
facility in instructional design. It is not 
unusual in the beginning for new CAL 
authors to believe that writing instruc- 
tional material amounts to little more than 
the transfer of their lecturing notes onto the 
computer system. Many would be authors 
believe also, that it is sufficient to give 
students new information as written text 
on a screen followed by a question as the 
only teaching strategy. If the students get 
the correct answer, the lecturer assumes 
that the students know and understand the 
content. Such naivete has dogged the 
widespread adoption of CAL since the 
mid-196(rs. 

Clearly, would be authors need to be 
knowledgeable of teaching strategies such 
as Drill, Test, Inquiry, Simulation, Tutorial 
and Serendipity. These strategies can only 
beapplied in an appropriate mix when the 
appropriateness of using CAL has already 
been determined. Unfortunately, the 
acquisition of teaching strategies is not a 
normal part of an academic staff members 
training, so unless academic staff make a 
deliberate effort to seek assistance, their 
teaching programs will be distinctly ama- 
teurish. 

It would seem reasonable then for an insti- 
tution which is committed to fostering 
better teaching, by whatever medium, 
should be concerned that its staff be prop- 
erly trained in these techniques. Many 
universities in Australia already have or- 
ganizational structures in place to carry out 
this kind of training. However, the effort 
will still be that of an individual lecturer. 
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In the commercial world, in contrast to the 
academic world, computer based training 
iCTB) is seen very much as a team effort. A 
team in which the content specialist may be 
a different person from the author. Such a 
team may consist of an author, a program- 
mer, a content specialist, a graphics design 
artist and a psychologist. In business, 
where costs must be contained, a team 
approach to the development of computer 
based training materials is taken as a must. 

If universities are going to take a lead from 
business, there is an obvious need to estab- 
lish teams skilled in the use of CAL. A CAL 
Unit will have a more precisely defined set 
of responsibilities than the existing Higher 
Education or Tertiary Institutes. It will 
more often than not co-exist with a Tertiary 
Institute and make calls on its staff for their 
specialized knowledge in staff develop- 
ment and student assessment. 

With the futures as described earlier, it is 
important that a highly skilled and knowl- 
edgeable team be assembled to assist uni- 
versity staff increase their effectiveness as 
teachers. For them, there is the auaed 
reward in having used CAL techniques in 
their teaching, of having more discretion- 
ary time to devote to individual students 
and their problems, as well as to research 
work. 
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Recent work in instructional psychology has 
strongly influenced the development of a new 
study strategies diagnostic and teaching pro- 
gram for tertiary students. The program will 
cover some hundreds of strategies, largely con- 
ceived of as academic tricks of the trade, and 
associated attitudes. In using the program stu- 
dents are asked if they use each strategy, or hold 
particular attitudes, via multiple choice ques- 
tions. After responding they are provided with 
comments justifying preferred answers. Pre- 
liminary trials with both computer and booklet 
presented material have shown excellent accep- 
tance by 112 C.A.E. students. 



Tertiary education is a mystery to many 
students in the sense that they cannot cope 
and don't know why. For these students 
die following scenario is typical. They ar- 
rive at college or university after having 
negotiated twelve or more years of educa- 
tional hurdles. Their expectations are fre- 
quently buoyant because they have dem- 
onstrated their competence, over and over, 
and there seems little reason to believe that 
success will not continue or that there is any 
real need to change their methods. Statisti- 
cal evidence of high drcp-out and failure 
rates (usually regarded as being some- 
where between 40 and 60 percent), if 
known to students, is disregarded, the "it 
won't happen to me" belief prevailing. But 
then things start to go wrong. Reading 
becomes difficult, both in the amount re- 
quired and in comprehending what is writ- 
ten. Lectures and tutorials are unfamiliar 
means of instruction. Written work which 
previously satisfied teach ss is now criti- 
cised or rejected. Higher standardsof spell- 



ing and grammar are applied. Workloads 
exceed those previously experienced. Re- 
sponsibility for learning, previously borne 
by teachers, is now thrust abruptly onto 
students. As students struggle to cope, 
often with little guidance, they fall behind 
with work deadlines, with an associated 
decline in work quality. Failures and drop- 
outs ensue. It is a picture familiar to any 
tertiary teacher as well as to student coun- 
sellors and, ultimately, to many students. 

Secondary education is frequently blamed 
for not "preparing" students for tertiary 
studies, by the public as well as by academ- 
ics. Even my corner deli, proprietor com- 
mented, 'The schools don't learn them 
nothing nowadays". The students them- 
selves are often accused of laziness while 
others blame poor standards of tertiary 
teaching. 

There are clearly many places in the system 
where attempts at remediation might be 
undertaken. One of these areas, currently 
attracting interest, particularly in the 
U.S.A., (Weinstein & Underwood, 1985; 
Dansereau, 1985; Weinstein & Mayer, 1986, 
Paris & Wixson, 1983; Brown, Campione & 
Day, 1981; McKeachie, Pintrich & Yi- 
Guang Lin, 1985), is that of teaching stu- 
dents reading and study strategies. This 
paper gives some preliminary retails of 
one such attempt in an Austral* n College 
of Advanced Education. Th effort has 
attracted strong student support and staff 
interest but systematic valrdatiun studies 
have yet to be undertaken. The aim of the 
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work has been to teach students strategies 
they presently do not use and to identify 
and at least partially remediate many of the 
defective methods and attitudes which 
prevent students from performing ade- 
quately. This is attempted via a question- 
ing of students about their use of a large 
number of specific strategies, and of a lesser 
number of attitudes, and then, by com- 
menting on their responses, to indicate the 
reasons why particular answers are pre- 
ferred. 

A computer presentation of the questions 
and comments has been favoured princi- 
pally because of the control thus provided 
in evaluating the adequacy of the study 
strategies program and in making needed 
modifications. 

Conceptual Framework 

This work has been strongly influenced by 
the cognitive approach to learning where 
students are seen, not as passive recipients 
of information provided, but as active 
agents using previously acquired knowl- 
edge and skills to select and process parts of 
that information in line with their existing 
schemata (Anderson, 1985; Wilson & An- 
derson, 1986), 

In the activities of selecting and processing 
students must use thei*- working memories 
which have processing and storage func- 
tions competing for use of a limited capac- 
ity (Baddeley & Mitch, 1974; Case, 1978; 
Daneman, 1984). If capacity is taken up, for 
example, in attempting to decipher i* fa- 
miliar words in reading, there will be a 
diminished capability to keep track of the 
argument, to anticipate what comes next, 
or to ask oneself questions etc. 

Students are also seen as having a capacity 
to reflect on their own processes, to be 
aware of the existence of various strategies 
and to monitor their success with strate- 
gies, changing them where necessary. 

O 
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Students are also viewed as having a capa- 
bility to consider various op tions f or organ- 
ising selected input. Such metacognitive 
strategies (Brown, 1985; Brown, Armbrus- 
ter & Baker, 1986; Lawson, 1984) have been 
shown to play a vital role in reading and 
studying. Study strategies are thought of 
as ways of undertaking specific tasks and 
very large numbers of such strategies, 
probably thousandsof them, are thought to 
be involved in skilled performance as a 
student 

Skilled students, however, are not likely to 
be conscious of their use of well practised 
strategies since consciousness of skills re- 
cedes as they develop (Fitts & Posner, 
1967), It is thus extremely difficult, in the 
case of intellectual skills, to find out how 
skilled performers actually operate. Fur- 
ther, even when a strategy used by a skilled 
person can be identified, it may not be 
possible to teach that skill directly to an 
unskilled person, because the latter may 
not possess necessary entering behaviours. 

Skilled performance, at any given time, is 
not seen, however, as a simple function of 
individual learning (Vygotsky, 1978; Day, 
1983). Performance takes place in a social 
environment from which varying amounts 
of assistance - from teachers, tutors, other 
students, counsellors, libraries and other 
resources - may be obtained. Reliance on 
these external resources for skill develop- 
ment diminishes as students internalise 
new skilk ere is thus a need to ensure 
that external supports are appropriately 
provided and appropriately used - not too 
much, not too little - in the development 
and internalisation of skills. 

But more than intellective strategies are 
involved in the success of students. There 
is also a need for hard work, for effective 
time management, and for appropriate 
attitudes, even attitudes about the nature of 
learning itself. There is also a need for an 
accurate grasp of the expectations of aca- 

27 3 



264 

demic staff, for social skills in dealing both 
with fellow students and with academic 
staff/ and for an understanding of the or- 
ganisational setting within which students 
have to operate. Further, there is a need for 
students to learn strategies for self control 
and for handling stress and emotions. 

No doubt many students succeed while 
exhibiting defects in some of these areas, 
perhaps by compensating with strengthsin 
others. An example is the student who has 
poor abilities in many areas but who works 
very hard. 

Students who have been involved with this 
program use the concept of "getting 
enough things right", and however impre- 
cise, and ungrammatical, that expression 
may be, it probably captures the major 
requirement for success. 

American study strategy programs, (W ein- 
stein & Underwood, 1985; Weinstein & 
Mayer, 1986; Dansereau, 1985) have tended 
to concentrate on intellective type strate- 
gies such as reading comprehension and 
memory skills, whereas in this program a 
much broader view has been taken with 
cogitative, affective and social skills being 
stressed in addition to cognitive ones. 

Methodologically the program is seen as a 
multi-faceted, compound treatment, very 
much in the "shotgun" tradition. Such 
treatments are favoured by experienced 
teachers but largely ignored by psychologi- 
cal researchers because of the difficulty of 
sorting out the respective contributions of 
various elements in the treatment. See 
however, (Brown, Palincsar & Armbruster, 
1984) who argue for a research strategy of 
first securing educationally relevant and 
transferable treatment effects by the use of 
multiple treatments and then, at a later 
stage, of attempting to isolate individual 
tr atment effects. 

The items chosen for the program were 
expressed in question form, with students 
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being asked if they used each strategy or, in 
the case of attitudes, held each attitude. 
Multiple choice options were provided for 
responses using a four category format. A 
questioning mode of presentation of mate- 
rial was chosen because of the known bene- 
ficial effects of questions in aiding reading 
comprehension, (Duffy, Roehler 5c Mason, 
1984; Andre & Anderson, 1978) and be- 
cause early trials using questions without 
comments had been well accepted by stu- 
dents. 

It was thought that students using the 
program would identify some strategies 
which they were already using and gain 
added assurance and confidence thereby. 
Second, they would identify some strate- 
gies which would require little effort to 
adopt since most of the required entering 
behaviours were present. A third group of 
strategies encountered would require 
varying degrees of effort by students to 
learn and would be unlikely to be adopted 
without that effort. None-the-less, aware- 
ness by students that such latter strategies 
existed was thought likely to provide a 
series of quite specific goals for strategy 
learning by students. Quite apart from 
specific strategies, it was anticipated that 
working through some hundreds of strate- 
gies in a series of sessions would be likely to 
have a large and durable effect in that stu- 
dents would be far more likely to think 
about, question and monitor their methods 
than in the past. The need for students to 
think about their methods and about what 
they are trying to learn has been stressed by 
many writers, (Tobias, 1982; Day, 1980; 
Biggs & Rihn, 1984). 

Selection of items for the program 

Items vvere constructed using information 
gathered from the following sources:- 

a. Strategies which have been used by 
researchers in leading and studying. 

b. Strategies identified in previous study 
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strategies inventories (Brown & 
Holtzman, 1965; Dansereau et ai, 1975). 
c T^ical "How to Study 7 ' handbooks 
(Pe^y, 1983; NZ. Council for Educa- 
tional Research, Study Habits Evalu- 
ation and Instruction Kit, 1979; 
McEvedy & Jordan, 1986). 

d. The literature on teaching reading 
strategies e.g. Kerber 1978. 

e. Discussions with and observations of 
students. 

f. Discussions with a;ademic colleagues 
about their strategies. 

g. Introspection of my own strategies in 
reading and studying. 

The search for strategies and attitudes wac 
not restricted to efficient ones but also in- 
cluded several which have been identified 
as inefficient for students jr appropriate 
only for an earlier stage of development. 
The "telling air strategy for answering 
essay and examination questions, in which 
students simply write down all they know 
about topics, and the "copy delete" strat- 
egy for summarising texts, in which the text 
is simply copied less unimportant details, 
are exam/'es. 

Additionally, attention was given to strate- 
gies which have been studied with both 
primary and secondary students but which 
were thought likely still to be used by some 
tertiary sbidents. The "telling all" and 
"copy delete" strategies are examples. 

Finally, some strategies were included 
which were thought li> ly to be used by all 
students, to ensure L at at least some of the 
methods about which they were ques- 
tioned would be seen as appropriate. 

The classification of strategies 

The strategies and attitudes were classified 
into categories which were, for the most 
part, seen by students as major problem 
areas* Tne categories presently completed 
are:- 



a. Learning new vocabulary - 60 items. 

b. Preparing essays and assignments - 60 
items. 

c. Preparing for tests and exams - 60 items. 

d. Taking examinations - 20 items. 

e. Reading productively - 140 items. 

Other categories planned include :- 

f. Using tutorials to learn. 

g. Learning from lectures. 

h. Time management. 

i. Improving motivation. 

g. Managing stress and anxiety. 

Preparation of comments 

Comments were prepared for each ques- 
tion in the program expla.ning the reasons 
for prefdred answers. The comments were 
written in a conversational manner and for 
the most pr^t drew on empirical studies or 
psychological theory for their content. 
Where that was not possible comments 
were based on teaching experience. In 
some comments small amountsof informa- 
tion were included about empirical studies 
or basic psychological theory supporting 
the program. Important principles were 
repeated in comments on a number of re- 
lated strategies. 

Examples of questions and comments used 
in the program are shown in Appendix 1. 

Presentation format 

TL .ee alternative formats have been 
planned for computer presentation to en- 
hance the utility of the program both as a 
research and diagnostic instrument and as 
a teaching or tutorial device. 

a. Questions only - for research purposes. 

b. Questions only in blocks of 20, followed 
by a repetition of the questions, this time 
with each question being accompanied 
by a comment and the preferred an- 
swer. This format combines both re- 



ERLC 



27 5 



266 



Using Computers Intelligently 



search and tutorial functions, 
c. Questions, each with associated com- 
ments. This format would be used 
mainly for tutorial purposes. 

Twenty question blocks, rather than some 
other number, were chosen to balance the 
need to provide reasonably short work 
periods against the need to obtain reliable 
data for analytical purposes and for reports 
to students. 

In an early compute presentation of the 
program format (a) was used, while in later 
hard copy trials format (b) was used. In 
future computer presentations using for- 
mats (b) and (c), reports will be given to 
students after each block of 20 items. The 
reports will relate a student's score to estab- 
lished norms and recommend remedial 
actions. These might include reading fur- 
ther instructional material.(Clark, 1986a, 
1986b) consulting a student counsellor or 
working through practice examp les of new 
strategies etc. 

Preliminary trials with the program 

Almost all of the effort which has been put 
into this work so far has been directed at 
completing segments of the program and 
making these available to students many of 
whom are struggling to cope with their 
work. Initially a 417 item questionnaire 
was offered, both on computer terminals 
and on hard copy, to 80 second year Busi- 
ness Studies Degree students. Students 
completed the questionnaire outside of 
class time in 4-6 sessions as part o/ their 
course work in a one semester unit, Admin- 
istrative Studies 1. Subsequently these 
students were required to write an essay 
saying what they saw as their major prob- 
lems as students and what they proposed 
to do about those problems. Three hour 
long lectures and three hour long tutorials 
were used to introduce some of the psycho- 
logical principles involved. Finally, a short 
questionnaire se Bking opinions about *\ I *at 



had been learned from the whole exercise 
was completed anonymously by these stu- 
dents. 

All but two students regarded the exercise 
as a worthwhile one and indicated they 
wanted the work continued and extended. 
Specifically they wanted a one r emester 
course in study methods introduced in the 
first yearof their course. All of the students 
commented about their disappointment 
that most of the strategies covered in the 
program had not been taught in secondary 
schools and most claimed to have given 
little thought to their own methods hith- 
erto. 

Although a reduction from 50% (n=83) to 
37% (n=88) occurred in the combined drop 
out and failure rate for this unit when 
compared with the previous year, results in 
other units suggested a better group of 
students was involved in the present year. 
Additionally other changes in the teaching 
a: 'xamh ung of the unit were introduced 
wl a may also have had effects. It was 
thus AOi possible to assert, with any confi- 
dence, that the Improvement cited above 
resulted from the use of the program. 

The computer presentation used for this 
work was flawed by programming bugs, 
slow screen presentation times due to 
computer overload, poor segmentation of 
the program and, in a few cases, poor 
wording of questions and of multiple 
choice alternatives. None-the-less, despite 
all problems, the work was strongly sup- 
ported by students who also provided 
encouragement for the development of the 
revised, categorised version of the pro- 
gram, including comments. 

At the time of writing, July, 1987, 32 stu- 
dents have completed, on a voluntary ba- 
sis, some or all of the first four categories of 
questions described earlier and other s f, i- 
dents are daily seeking access to the pro- 
gram. No proper analysis of the perform- 
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ance of these students has been made be- 
yona that of checking that better students 
are performing better on the program. 

The rr\,ponse of students to this second 
verrion of the prog/am has been very en- 
thusiastic, many or them claiming to have 
altered their study methods as a result of 
completing sections of the program. 

Discussions with other staff members have 
suggested that there may have been some 
transfer of skills to other areas. 

Future work 

Besides working to complete additional 
segments of the program, work is now 
underway to set up the presently com- 
pleted parts of the program on <x\ IBM. 
System 2, Model 50 computer with Model 
8514 high resolution colour screen, using 
the FORGE computer based learning soft- 
ware package. The latter provides for the 
design, layout, graphics, authoring, colla- 
tion and management of an instructional 
program. 

Once this work is completed, systematic 
trials will be undertaken to assess the worth 
of the program, to establish norms, to de- 
velop reports for students and to modify 
theprogramwhererequired. Longitudinal 
studies to ascertain if study skills improve 
during the period of a degree course are 
also planned. 

While it would be quite wrong for anyone 
to believe that a relatively brief exposure to 
this program would "solve" the many 
problems faced by students referred to 
earlier, it does seem likely that, with appro- 
priate course integration, the program 
could find a place in, or as an adjunct to, 
study strategies teaching programs and 
student counselling ir many tertiary and 
some secondary institutions. 
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Appendix 1: Examples of ques- 
tions and comments used in the 
study strategies program 

Q.l I believe my teachers and lecturers, 
rather than me, are responsible for 
teaching me any new words I need 
to know: 

(a) Yes, I strongly believe that. 

(b) Yes, I believe that 

(c) No, I don't believe that. 

(d) No, I strongly oppose that. 

COMMENT: Most lecturers and teachers 
would be likely to explain important new 
technical concepts. But they are unlikely to 
have enough time to deal with every new 
technical term. Additionally, they are un- 
likely to spend much time in teaching you 
many non technical words. So, for the most 
part, learning new words is up to you. 

The preferred sequence of answers is there- 
fore d,c,b,a. 



Q.2 I set myself a target of learning a 
certain number of words every day: 

(a) Yes, that is true for me. 

(b) Yes, I do that every so often. 

(c) No, I rarely do that. 

(d) No, I have never done that. 

COMMENT: The importance of a large 
vocabulary and its connection with your 
ability to read and write w*ll, has been 
stressed in several other comments. So a 
definite plan to increase your vocabulary is 
an excellent strategy, provided that correct 
strategies are used (see other strategies for 
hints) to ensure that such learning is effec- 
tive. Think of this: 10 new words a day 
would mean 3650 new words a year, and 
over 10,000 new w^rds over the three years 
of a degree. Such an Increase in vocabulary 
could be expected to rrukc your work as a 



student a lot easier and to improve your 
performance. 

The preferred sequence of answers is there- 
fore, a,b,c,d. 



Q.3 When I am reading for an essay, 
assignment or report I ask myself 
frequently, (at the end of para- 
graphs, sections, chapters etc.) 
"What is the author's argument in a 
nutshell in this part?" I do this: 

(a) Almost always. 

(b) Most of the time. 

(c) Sometimes. 

(d) Almost never. 

COMMENT: This is a very usetul summa- 
risation strategy and a good way of fitting 
in new information with your existing 
knowledge. The action of summarising, in 
your own words, which is integral to this 
strategy, helps tie in the new with the old. 
The strategy is also a precursor to the strat- 
egy of keeping a running check in your 
mind of a developing argument, where, 
with each new paragraph, you run over in 
your mind the sequence of arg ^ment up to 
that point. 

The preferred sequenceof answers is there- 
fore a,b,c,d. 



Q.4 If I do poorly in an essay, assignment 
or report I consult my lecturer about 
which students did well and ask him 
to arrange for me to read two or three 
of the top efforts so that I can note 
differences in standards and in ap- 
proach to aid me in future efforts. I 
use this strategy: 

(a) Very frequently. 

(b) Frequently. 

(c) Sometimes. 

(d) Almost never. 



ERLC 



279 



270 



Using Computers Intelligently 



COMMENT: Students often learn things 
better from each other than from their lec- 
turers. Perhaps it isbecause there is a more 
relaxed relationship between students. 
Whatever the reason it makes sense to try to 
get a line on differences in standards so that 
you know just how much, and in what 
directions, you need to improve. 

The preferred sequence of answers is there- 
fore a,b,c,d. 



Q.5 I think the sole purpose of essays, 
assignments and reports is to test the 
knowledge of students of course 
content in particular subjects: 

(a) Yes, I am quite sure that is true. 

(b) Yes, I am fairly sure that is true. 

(c) No, I don't think that is true. 

(d) No, I am quite sure that is not true. 

COMMENT: It certainly is true that essays 
etc. test your knowledge of different sub- 
jects. But they often have another objective 
which is sometimes not fully grasped by 
students. That objective is to see if students 
can handle the analysis and discussion of 
complex verbal issues with the required 
skill and whether they demonstrate the 
required depth of thought seen as appro- 
priate at a tertiary level. Now, if you don't 
know of the existence of this second goal 
there is a fair chance you won't give it the 
required attention - with dire conse- 
quences. 

The pref erred sequence of answers is there- 
fore d,c,b,a. 



(a) Very frequently. 

(b) Frequently. 

(c) Sometimes. 

(d) Almost never. 

COMMENT: This strategy is one of the 
most useful of ail for tertiary level students 
to learn. The strategy allows good summa- 
risation, comparisons and helps memory. 
An extension of the strategy allows sub- 
categories in one or both sides of the table. 

The preferred sequence of answers is there- 
fore a,b,c,d. 



Neil Clark is a psychologist and ienior 
lecturer in organisational behaviour 
and administration at the Bendigo 
C.A.E. He believes that C.A.L. will be 
particularly useful in the develop- 
ment and testing of his tertiary level 
study strategies program and of a 
similar program for use with secon- 
dary students. 



Q.6 When I have to remember different 
theories or approaches to a topic for 
a test or examination, I draw up 
tables listing important criteria or 
characteristics so that they can be 
readily summarised and compared. 
I do this: 
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Computers are a valued resource in the instruc- 
tional process, however they need to be used 
intelligently. One way of doing this is to use the 
computer as an experimental tool, to centre the 
learning activity on the student and provide a 
means to aid students' understanding of con- 
cepts. This paper details how a team from 
Capricornia Institute developed Cap-Graph, a 
sophisticated graph plotting package. This 
package is an experimental tool which, with 
appropriate worksheets, can be used by a wide 
range of students to develop and deepen con- 
ceptual understanding in their mathematics 
courses. Cap-Graph has been trialed in a labo- 
ratory situation with an internal mathematics 
subject for biology students. The results of this 
trial and the implications for incorporation of 
Cap-Graph experiments in other mathematics 
courses is discussed. 



At last year's CAUTE conference, one of 
the authors, Debbie Clayton, spoke about 
CAL trends ir tertiary mathematics that 
she had obser* jd in the UK and USA. One 
trend in undergraduate mathematics was 
away from the traditional dialogue/ tuto- 
rial mode of the I96tfs and 197(Ts to Com- 
puter Enhanced Learning (CEL). This term 
was coined by Professor Avi Bajpai of the 
University of Technology in Loughbor- 
ough (Bajpai, 1985). 

In ~ CEL application, the computer is put to 
"best" use by being either: 

• an electronic blackboard, 

• a numerical utility, or 

• an investigational /experimental tool. 

When the machine is used for investiga- 
tior /experimentation, sophisticated 



pieces of software are used as tools in a 
laboratory setting to assist the student to 
understand mathematics. Worksheets or 
experiment sheets are used in the labora- 
tory to guide the student interaction with 
the software. 

This paper describes the development and 
use of such a software tool. Cap-Graph is a 
function plotting package, which, wii.li 
appropriate worksheets has been trialed at 
Capricornia Institute to assist students 
studying an introductory mathematics 
subject for Biologists. The potential for the 
use of a piece of software such as this in 
other mathematics subjects is also ad- 
dressed. 

Rationale 

Why develop a graph plotting package? An 
easy to use function plotting program, can 
be employed by students studying a wide 
variety of subject areas. For example, a 
Calculus student can use it to plot a func- 
tion with a discontinuity when studying 
limits. A Statistics student can plot proba- 
bility density functions with different para- 
meters on each graph. This wide range of 
usage options, as well as the plotter's capa- 
bility to graph quite complex mathematical 
functions makes it an "intelligent" choice 
of software tool. 

The provision of such a tool to students was 
seen as one approach to assisting them in 
more easily attaininga holistic understand- 
ing of the graphical behaviour of functions. 
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Cap-Graph aims to assist students to learn 
their mathematics by presenting visual 
representations of the functions that they 
are studying. 

The Software 

Design Considerations 

The Cap-Graph software was developed 
utilising the abhors different areas of 
expertise. Defining the goal of the project 
and general system specifications was 
undertaken by the academic members of 
the team, whilst the programmer wrote 
the software. Close consultation was 
maintained between all three members of 
the team. 

The program was written in Turbo 
Pascal, and extensive use was made of 
the Turbo Graphics Toolkit. Tuibo Pascal 
was chosen to allow easy portability to a 
variety of machine configurations. The 
use of the Graphics Toolkit reduced 
development time in creating the user 
interface. 

One of the aims of the system design was 
to produce a program which could, or be 
easily converted to, run on both NEC III 
and IBM compatible computers. The 
Capricornia Institute has a laboratory of 
20 NEC APC III computers. In addition, 
similiar machines are installed in the 
Capricornia Institute's External Study 
Centres (13) located throughout Queens- 
land. Many students own or have access 
to machines with IBM compatible graph- 
ics. Although NEC APC III computers are 
MS-DOS machines, the graphics are 
different to the de facto IBM standard 
graphics. Versions of Cap-Graph have 
been developed to run on machines 
which are compatible with the following: 

• NEC APC III 

• IBM PC, XT, AT with one of the 
following graphics cards 
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CGA (Colour Graphics Adapter) 
EGA (Enhanced Graphics Adapter) 
Hercules (Hercules Graphics Board) 

User Int rface 

It was necessary to ensure that the software 
was simple to use, to try to minimise stu- 
dent time required to become familiar with 
the program. The target audience for the 
program may not have touched a computer 
before, and students may be using the 
program away from any immediate assis- 
tance. 

To achieve the aim of creating a software 
package which was ea&y to use and hence 
aid students learning; screen layout, user 
control, feedback and on-line help were all 
considered an essential part of the user 
interface. Possible outcomes of poorly de- 
signed or inappiopiiate interfaces aie 
stated by Price (1985) as : 

• the user refuses to make use of the 
system after initial testing; 

• the user learns a few commands 
'parrot fashion' and relies on us- 
ing this, hence he/she cannot 
make use of all the system's facili- 
ties; or 

• an intermediary is used who then 
becomes the local system expert. 

Screen Design 

Research into colour screens indicates 
th^re should be a strong contrast between 
fo.oground and background colour inter; 
sities (Issacs, 1986). Research has also been 
reported on colour combinations which 
meet a minimum criteria for legibility 
(Oliver, Sullivan & Ban, 1982). The colour 
combinations used in Cap-Graph comply 
with these findings. 

The screen has two main functional areas, 
which areused consistently throughout the 
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program (Godfrey & Sterling, 1982). The 
top line of the screen is displayed as a blue 
foreground on a yellow background. All 
command key options and error messages 
are shown on this line. The remainder of the 
screen has a yellow foreground on a blue 
background. These colours also provide 
good contrasts on monochrome displays. 
Main menu options are shown on the sec- 
ond line. 

The screen design is basically one of a split 
screen with pop-up windows. Commands 
are listed at the top of the screen, and the 
graph displayed on the remainder of the 
screen. Pop-up windows are used to dis- 
play sub-menus, help screens, user inputs 
and feedback on invalid syntax of user 
entered functions. Sub-menus, displayed 
in pop-up windows as required, occur at 
the top of the screen. Help is available 
throughout the program and is displayed 
in a pop-up window at the bottom of the 
screen. Current research tends to favour 
the use of pop-up windows to keep the 
screen uncluttered (Issacs, 1986). 

User Control 

Control of the program is maintained by 
the user with the cursor keys, the Return 
and Escape keys, and the Help or Fl key. 
Escape is always used to return control to 
the user by aborting the current process 
and returning to the main menu. The Re- 
turn key is always used to accept input or 
select the highlighted menu option. The 
position of th ,se keys (and different return 
key symbols) on the keyboard are ex- 
plained at the beginning of the program. 
Menu options can be selected using either 
the cursor keys or the unique letter indica- 
tor for each option. 

Feedback 

Feedback to the user is provided during the 
graph drawing/calculating process by ~ 
small line which moves across the top of the 
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screen. Explanatory feedback is given 
when invalid syntax in mathematical ex- 
pressions is used. 

Help 

A detailed help facility has bee" designed 
as an integral part of Cap-Graph. Help 
provided depends on the users location in 
the program. Context sensitive help, avail- 
able at all times, is considered essential in 
CAL programs (Hartley, 1986). Approxi- 
mately 60 different help screens have been 
deluded in the program. 

Program Features, 

Equations are entered in functional nota- 
tion form. The scaling of the graphs is de- 
fined in terms of domain and range, and 
scientific notation is used, by the program, 
for large numbers. 

Functions are entered by initially defining 
the dependent and independent variables. 
These are restricted to the English alphabet. 
In addition, the irrational number e is de- 
fined as a constant, so use of this letter is not 
encouraged. The program can store 26 dif- 
ferent functions. The screen, however, is 
never automatically cleared so an infinite 
number of equations can be displayed at 
one time by editing then drawing the func- 
tions. Any of the previously defined func- 
tions may be edited by attempting to enter 
a function with the same dependent vari- 
able. A facility also exists to charge the 
most recently entered, or edited funi. ion. 

A wide variety of mathematical functions 
can be drawn using Cap-Graph. Both con- 
tinuous and discrete functions can be dis- 
played. Discrete functions are entered us- 
ing the predefined integer component 
function. It is possible to display Binomial, 
Poisson, Normal and Exponential distribu- 
tions using this approach. Taylor's Series 
approximations can be easily shown and 
the improvement in the approximation 
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with each successive term clearly demon- 
strated. 

Cap-Graph can also draw either the firstor 
second derivative of the most recently en- 
tered, or edited function. 

Defined Operators, Functions and 
Constants 

The normal mathematical operators are 
available, namely: 

+ addition 

- subtraction 

* multiplication (unnecessary if unambi- 
guously implied) 

/ division 

A exponents (5 cubed is entered as 5 A 3) 

! factorial (valid for whole numix /s). 

Functions included are: 



sin(x) 

cos(x) 

tan(x) 

arcsin(x) 

arccos(x) 

arctan(x) 

sinh(x) 

cosh(x) 

tanh(x) 

arcsinh(x) 

arccosh(x) 

arctanh(x) 

exp(x) 

ln(x) 

log(x) 

sqrt(x) 

sqr(x) 

rad(x) 

u(x) 

int(x) 

fract(x) 

round(x) 

abs(x) 



trigone metric sine 
trigonometric cosine 
trigonometric tangent 
inverse trigonometric sine 
inverse trigonometric cosine 
inverse trigonometric 
tangent 

hyperbolic sine 
hyperbolic cosine 
hyperbolic tangent 
inverse hyperbolic sine 
inverse hyperbolic cosine 
inverse hyperbolic tangent 
exponential function (e A x is 
also valid) 
natural logarithm 
common logarithm 
square root 
squared function 
converts the operand from 
degrees to radians 
heaviside function 
integer component 
decimal component 
rounds to the nearest integer 
absolute value 



Constants 

The constants e = 2.718281828 

pi = 3.141592654 have been defined. 

One of the more powerful features of the 
program is the ability to definea function in 
terms of previously defined functions. That 
is, if the functions f(x) and g(x) have been 
entered, the the following functions are 
examples of valid functions 

h(t) = f(t)+g(t) m(s) = f(g(s)) 
p(x) = abs(f(x)+g(x)) 

Scaling 

The scale of the graph is user defined as a 
minimum and maximum for the domain 
and range. In addition, there is an au- 
torange facility which will calculate a range 
so that at least 90% of all functions stored in 
the system will be displayed on the screen. 
Scaling is limited to numbers between +/- 
999999999 to +/- 0.000000001. 

Zoom Facility 

A facility has been built into the program to 
allow close examination of parts of the 
graph. This option allows the user to zoom 
in on a region of the screen. The magnified 
section is displayed in a window on the 
screen which can be moved so that the 
original graph is not obscured. 

The coordinates of the centre of the win- 
dow are displayed, (to ten figures) at the 
top of the screen together with the width of 
the window, for example +/- 0.33333. Us- 
ing fh2 coordinates it is possible to find 
points on a graph to a maximum 10 signifi- 
cant figures. 

Magnification of an adjacent region can be 
easily displayed using the cursor keys. The 
effect of this facility is similiar to moving a 
magnifying glass over a piece of paper. 
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Magnification of the zoom window can be 
reset at any time. The centre of the zoom 
window is set by defining the coordinates 
or by using the cursor keys. 

Options 

Hard-copy printouts of the screen can be 
obtained from Cap-Graph. Six different 
Epson printer modes are supported which 
will print the screen in different sizes and 
height-width proportions. 

Computer Enhancement 

The development of the software is per- 
haps the easiest part of computer enhance- 
ment. The enhancement of a subject (once 
the software tool exists) proceeds in the 
following manner: 

• The syllabus is reviewed. Areas where 
students experience difficulty with 
their mathematics and could be assisted 
by a visual function representation are 
identified. 

• In these areas, student centred interac- 
tions with the software are constructed 
by writing guided experiment / work- 
sheets that can be used in a laboratory 
setting. 

• A possible worksheet structure is: 

the aim/s of the experiment 

the necessary mathematical background the stu- 
dent needs to proceed with the experiment 

reference /s to appropriate texts 

instructions /elated to what activities the student 
should go through with the software 

student questions related to those activities. 

Designing these experiment/wor! sheets 
so that the desired learningoutcomesi esult 
for this guided interaction is rather diffi- 
cult. For this, educators need to develop 



special skills related to the usage of this 
new teaching technology. 

The Trial 

The plotter and ju worksheets 

have been trialed by an internal firsf ; ear 
biology degree mathematics class. During 
the semester these students worked 
through four experiment sheets in a labora 
tory setting. Instructors (the authors) were 
present to assist with both mathematical 
questions and questions about the soft- 
ware. The four worksheets for the experi- 
ments related to the topics: 

Linear and Quadratic Functions Limitsand 
Continuity Exponential and Logarithmic 
Functions Derivatives and Curve Sketch- 
ing. 

As an example of the type of activities in 
these interactions, consider the Quadratic 
Function section of the first worksheet The 
aim of this experiment was to develop the 
student's appreciation of the effect that 
each parameter in a quadratic function has 
on the shape of its graph. Here students 
were first asked to plot a parent graph of x 
squared. Then, in a systematic way, the 
parameters were changed and the student 
was required to write down statements on 
their worksheets as to the effect that each 
parameter had on the shape of the graph. 

At the end of the semester, the computer 
enhancement using Cap-Graph and the 
guic ed experiment sheets was evaluated 
by questionnaire. Eleven of the class of 
nineteen students responded. 

It was found that, in general, 

• the students Hi ed going to the micro- 
computer laboratory and working 
through the experiments with Cap- 
Graph. They found the program easy to 
use, and felt positive about obtaining a 
graphical representation of the func- 
tions they were studying. 
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• those students who had not used a 
computer prior to the interactions, now 
felt more confident about using the 
computers, and 

• the students considered it did hel p them 
to learn their mathematics. 

The students also made suggestions as to 
how the user interface of Cap-Graph, and 
how the format/content of the worksheets 
could be improved. These suggestions 
were incorporated where feasible. 

A Wider Audience 

Aftc-r the initial development and program 
testing with an internal class, Cap-Graph 
was made available to a wider audience. At 
the beginning of the second semester, 1987, 
copiesof the software were located in exter- 
nal study centres and in the Library at the 
Capricornia Institute. A number of staff 
access the program using personal com- 
puters on their desks. Whilst direct incor- 
poration of Cap-Graph as an electronic 
blackboard (in a lecture environment) has, 
as yet, not occurred, overhead transparen- 
cies of printouts from the program have 
been used. 

The authors are currently writi ng a series of 
experiment sheets to be combined into a 
booklet form. This material will be avail- 
able to students as resource material with 
the software in the Library and in external 
study centres. Lecturers, for a variety of 
subjects, will also be able to direct students 
to relevant worksheets as either an adjunct 
or as a formal component of the subject. 

Portability of the software has meant that 
compromises needed to be made in the 
program design and features included. The 
main constraint is restricting the memory 
usage to 256kb. Since many users wii! ha vp 
access to compatible computers without 
this lestriction, a more sophisticated ver- 
sion is currently being planned. Features 
being considered for this package are: 



Using Computers Intelligently 

• different colours for different graphs. 
This will not be possible on machines 
with CGA or Hercules graphics. 

• a system of being able to match the 
graph to the function after the function 
has been drawn, 

• an option to allow the definition of 
constants, 

• displaying the equation in the normal 
mathematical form after it has been 
entered, exponent above the base, 
numerator over the denominator. 

• a choice of scale to allow log-log and 
semi-log graphs to be drawn, 

• incorporation of a numerical integra- 
tion routine. 

Feedback from academics in disciplines 
other than mathematics indicates that the 
scope for use of a function plotter is wide- 
spread. Cap-Graph is capable of being used 
as a tool in diverse areas such as engineer- 
ing, financial mathematics, economics, and 
the behavioural sciences. 

Summary 

This paper has outlined the development 
and trialed use of a software tool that can 
enhance student learning of mathematics. 

Software tools such as Cap-Graph do have 
considerable potential in not only mathe- 
matics teaching, but also in several other 
disciplines. The scope of its use is wide, 
limited only by the imagination and ability 
of the instructor to construct experiments/ 
worksheets to guide student interactions 
to achieve desired learning outcomes. 

The authors hold that constructing soft- 
ware tools which can be used by a variety o' 
students and in a variety of subject areas is 
an intelligent use of CAL in the 80' s. 
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Updating Mathematical skills: An evaluation of 

a computer based mathematics course 



Michael J. Crock, Division of External and Continuing Education 
Darling Downs Institute of Advanced Education 



t> /dating Mathematical Skills is a continuing 
education course for students who wish to study 
at the tertiary level but who do not feel confident 
with their level of mathematical ability. The 
study materials consist of a study book, the set 
text "Self-Paced Introductory Mathemati~ , 
and an introductory audio cassette. All assign- 
ments for the course are completed on student 
answer sheets and computer marked with full 
feedback printed at the time of marking. Results 
and feedback are then forwarded to the student. 
Student progress records for all assignments are 
computer managed. The course has been fully 
operational for over 18 months with enrolments 
to date being over 300 students. Initial evalu- 
ation of the course shows a cost-effective utiliza- 
tion of computer managed learning, and a posi- 
tive response to the course structure and effec- 
tiveness by students. An interactive version of 
assignments is currently under trial. 



In any teaching-learning situation a large * 
proportion of the teacher's tf me is devoted 
tc prescribing learning activities, marking 
assignments, providing associated feed- 
back and keeping records. This feedback 
usually includes advise on learning prob- 
lems that have been diagnosed in light of 
student performance. A significant part of 
these activities cau be assigned to the com- 
puter thus providing the basis for a com- 
puter managed learning system. In 1983 a 
computer managed learning system was 
establ { shed at the Darling Downs Institute 
of Advanced Education and the essence of 
this computer managed learning is repre- 
sented in Figure 1. (Barker, White and 
Taylor, 1984). * 

Incorporated in ihe CML system is the 
development, by unit teams, of computer 



based LEARNING activities which pro- 
vide students with opportunities to test the 
effectiveness of their learning and obtain 
grades and feedback. The 'managed' as- 
pect of the system maintains records of 
siudents' use of CML activities, scores stu- 
dent learning activities and provides this 
data to lecturers. 

Thebreadthof the CMLactivi ties provided 
in the system range from 'conventional' 
CML, with its emphasis on managemen t of 
student records and scoring, to activities 
more representative of computer assisted 
instruction (CAI), involving extended 
feedback, branching programs, algorith- 
mization, and the linking of microcompu- 
ters and videodisc systems. 

To effectively utilize this CML system, the 
unit team needs to analyse and structure 
!he subject matter in question into appro- 
priate instructional modules, which re- 
quia 1 : 

1. the precise sequencing of instructional 
objectives, which dearly define ex- 
pected student learning outcomes; 

2. the careful selection of associated learn- 
ing activities, which clearly define stu- 
dent work programs; and 

3. the construction of tests, which aim to 
measure the extent to which students 
have achieved each of the stated objec- 
tives. (Barker, White and Taylor, 1984) 



tl& 288 



Using Computers Intelligently 



279 



By making this initial commitment to struc- 
ture the subject matter in this manner, the 
unit team can then expect to provide the 
students with the following potential bene* 
fits: 

1. early identification and refutation of 
problems — the pinpointing of student 
difficulties and the availability of this 
information to both students and exam- 
iners alike should lead to a rapid resolu- 
tion of problems; 

2. a clearly defined pacing mechanism — 
by meeting the deadlines set for the 
completion of each test, students can be 
sure that they are working through the 
materials at an appropriate pace; 

3. immediate individualised feedback — 
an assessment of the extent to which 
stated objectives have been achieved; 
diagnosis of difficulties and associated 
provision of a list of learning activities 
which should lead to improved per- 



formance. (Barker, White and Taylor, 
1984) 

The Updating Mathematical Skills course 
which is to be evaluated in this paper was 
developed using the Darling Downs Insti- 
tute of Advanced Education's CML system 
and unit team approach as outlined above. 

Updating Mathematical skills 

Updating Mathematical Skills is intended 
for students who wish to study at the terti- 
ary level but who do not feel confident with 
their level of mathematical ability. It can be 
taken individually as a continuing educa- 
tion course, or it can be taken as a compo- 
nent of the Preparatory Studies Pro- 
gramme, which is a currently operating 
external programme developed to provide 
an alternative means of entry to tertiary 
courses for mature age students. Using the 
concepts of self-paced instruction, and 
master/ learning the course guides stu- 
dents through a carefully sequenced series 



COMPUTER MANAGED LEARNING 
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Figure 1: Key elements of Computer Managed LEarning 
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of topics which provides the foundation for 
understanding the mathematics that will 
be encountered in tertiary studies. 

The self-paced structure of the course al- 
lows students to work through the material 
at a pace suitable to their needs, permitting 
them to work quickly through familiar 
materials, as well as allowing them the 
opportunity to seek additional assistance 
in areas of uncertainty. The mastery ap- 
proach ensures that students successfully 
achieve the objectives of each topic before 
progressing to the next topic, which builds 
upon on the earlier material. 

The main objectives of this course are: 

1. To increase the student's understand- 
ing and confidence in mathematical 
skills to a level which will enable a stu- 
dent to successfully deal with the maths 
they will encounter in their tertiary 
studies; and 

2. To develop a positive attitude towards 
mathematics which will assist the stu- 
dent in their understanding of basic 
mathematical concepts. 

The course material includes: 

1. An introductory audio cassette; 

2. The set text: SELF-PACED INTRO- 
DUCTORY MATHEMATICS (SPIM) 
Iry Dobson and Stokoe; 

3. Updating Mathematical Skills Study 
Book; 

4. A set of assignment labels for CML ac- 
tivities. 

The introductory tape gives students a 
brief introduction to the course as a whole, 
highlighting the important points they 
should be considering as they work 
through the course, and introduces stu- 



dents to a few of the team of course tutors 
who will be monitoring and assisting their 
progress. 

The set text (SPIM) contains the required 
content for the course and the study book is 
provided to guide students through the 
material by introducing topics, highlight- 
ing problem areas, and providing addi- 
tional worked examples and practice prob- 
lems. 

The structure of the course is based on the 
structure and sequence provided in the set 
text SPIM. Originally produced to provide 
the basis for a mathematics course for envi- 
ronmental science students, the style, con- 
tent and level of the material presented in 
SPIM lias been used to provide a solid 
mathematics base for studen ts enrolled in a 
wide variety of courses including science, 
business, and engineering tertiary courses. 

The study book, which has been specifi- 
cally designed to enhance the material anc 
facilitate the external teaching of th* 
course, guides students through SPIM's 14 
units, which have been grouped into six 
modules according to content. With the 
exception of the single unit Module 1, each 
module contains a series of two or three 
related units. The assignments for this 
course correspond directly to the modules. 

The following figure illustrates the break- 
down of the 14 units into the six modules, 
and briefly lists the contertt of each unit. 

MODULE UNITS CONTENT OUTLINE 

1 1 Number systems and 

elementary arithmetic 

2 2 Notation, order and 

inequalities 

3 Graphical representation and 
equations of lines 

4 Sets 

3 5 Polynomials and use of the 

binomial theorem 
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6 Functions 

7 Inverse f .ctions and 
graphing of functions 

4 8 Exponential and logarithmic 

functions 

9 Trigonometric functions 

1 0 Limits of sequences and 
functions 

5 11 Introduction to differentia- 

tion 

12 Applications uf differentia- 
tion 

6 13 Introduction to integration 

14 Techniques and applications 
of integration 

Figure 2: Course Structure and Content 



The sequence of the units has been care- 
fully planned to ensure that students prog- 
ress through the material in a logical build- 
ing block fashion. 

Assessment 

The assessment in the course is of two 
types: 

1. Self-Assessment which takes the form 
of pre-tests, exercises, and Sample quiz- 
zes in the study book and the set text 
SPIM. Such self-assessment items ; n 
this course are not required to be sub- 
mitted and are for the students' benefit 
to show them how well they are under- 
standing the material. The answers to 
all self-assessment items ai^ given to 
students in either the text or the study 
book. 

2. Formal Assessment, which takes the 
form of six CML module assignments. 
Each of these assignments has distinct 
sections for each unit of the text. (i.e. the 



assignment for module 2 has three dis- 
tinct sections, one for each of units 2, 3 
and 4 of SPIM.) 

Appendix A contains an example of a CML 
assignment and the marking sheet the stu- 
dent would be expected to complete. 

In order to successfully pass this course, 
students need to complete all six assign- 
ments and achieve a pass mark for each 
one. Assignments take the form of com- 
puter-marked tests and are only graded 
pass or incomplete. Student are always 
given feedback on incorrect answers and 
should they have an assignment marked 
incomplete, they are required to submit 
one of the two remaining assignments for 
that particular module, thus enabling the 
student to upgrade their standard of un- 
derstanding to a pass level. 

Appendix B contains an example of a 
student's marked assignment and feed- 
back specific to the responses the student 
has answered. 

The difficr 1 '/, style ar.d length of assign- 
ments corresponds closely with the scope 
and c v ntent of questions found in the pre- 
test and sample quizzes in the study book 
and text. 

The CML system permits answers to be 
multiple choice or exact answer, and the 
feedback given can be specific to an exact 
answer or to a particular numerical range. 

If students receive a pass for a particular 
module assignment, but for their own per- 
sonal benefit would like to submit any of 
the remaining parallel assignments, this 
may be done and the results do not affect 
the pass mark already achieved. 

Appendix C contains an example of the 
student record report used to monitor stu- 
dent achievement levels and progress 
through the course. 
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Student enrolments 

Although the teaching year at Darling 
Downs is divided into three periods, stu- 
dents may enroll in Updating Mathemati- 
cal Skillsat any time, as either a Continuing 
Education course or as part of the Prepara- 
tory Studies programme, allowing maxi- 
mum flexibility. However, the final exami- 
nation for the Preparatory Studies students 
is held only three times per year, in June, 
November and February. Studentsstudy at 
their own set pace, however, a student who 
wishes to study at about the same rate 
which is expected of people enrolled part 
time in accredited courses, such as the 
Bachelor of Business or the Associate Di- 
ploma in Engineering, should complete the 
course in approximately 18 weeks. 

During 1986, 194 students enrolled in the 
Updating Mathematical Skills course as 
Continuing Education students. Of this 
number 17 have successfully completed 
the course, while 152 are currently still 
actively enrolled andcontinuing studies. In 
this same year, 238 students enrolled in the 
course as Preparatory Studies students. Of 
these, 20 have successfully completed the 
course and gained entry to accredited 
courses, and 92 are still actively enrolled. 

So far in 1987, there are 106 students en- 
rolled as Continuing Education students 
and 207 students taking the mathematics 
course as part of Preparatory Studies. Out 
of this enrolment, 25 have already success- 
fully completed the course, with 24 of these 
gaining entry to accredited courses. 

The vast majority of both the 1986 and 1987 
students are mature age students who are 
interested in returning to tertiary studies 
after a significant number of years since last 
attempting studies of any description. Il- 
lustrating this point is an enrolment survey 
which shows that average time since last 
studying mathe -atics for the current 
group of over 300 students is 14.6 years, 



with individuals ranging between three 
months and 46 years since last studying in 
this area. The majority are also interested in 
attempting external studies while main- 
taining their current job position. While 
most f tu dents live in Queensland, there are 
also a number of interstate and interna- 
tional students registered in the pro- 
gramme. (Crock, 1987) 

To support and run the programme with 
these numbers there are three part time 
tutors in the Updating Mathematical Skills 
course. The course also utilizes Continuing 
Education administrative staff and DDIAE 
administrative services such as mailing, 
student enrolments, student support 
centre, and advertising. 

Methods of evaluation 

Students are given the opportunity to 
complete written questionnaires evaluat- 
ing each component of the Updating 
Mathematical Skills course, and in fact 
comment on each assignment and its re- 
lated material. Appendix D contains a 
sample of the evaluation form usod to col- 
lect data. The appropriate course develop- 
ment unit team then has the task of recom- 
mending programme improvement based 
upon students perceptions plus the team's 
evaluation of the students standards of 
achievement. In essence, this means the 
current evaluation of the course with refer- 
ence to meeting the previously stated ob- 
jectives, is based upon student's direct 
evaluative responses and student's 
achievement records. Subsequent im- 
provements to the material are then incor- 
porated in to the material where considered 
appropriate by the leader of the course 
development team. This process is carried 
out on an annual basis. 

Results of evaluation 

Dealing first with student evaluation of the 
course, Table 1, on the following two pages, 
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presents the results for the opinionnaires 
for modules 1 to 6. Responses range from 
"strongly agree" (=1) to "strongly dis- 
agree" (=4) and the table shows the mean 
response (M), the sample size (N) and the 
standard deviation of responses (SD). The 
final question listed on the table deals with 
the average number of hours required to 
work through a particular module. 

Table 1: Results for Student Evaluation. 

Evaluation based on student success rates 
is limited at thk stage as the course is still 
relatively new and there ire still a large 
number of both 1986 and K 37 students still 
actively completing the course. However if 
you examine the subsequent success rates 
of students who have continued on to ac- 
credited courses, having first successfully 
completed the Updating Mathematical 
Skills course, it appears th£ course "ias 
provided a solid mathematical back- 
ground, and signalled that students would 
be able to cope with tertiary level studies. 
Of the first 16 accredited course units( 
many containing mathematical compo- 
nents) attempted by success, al Updating 
Mathematical Skills students, the results 
obtained were: five As, six Bs, four Cs and 
only one incomplete. 

Discussion 

Evaluation forms submitted by students 
have been strongly in support of the Updat- 
ing Mathematical Skills course with respect 
to its format and perceived applicability in 
achieving the set objectivesof the course. In 
particular, while it was expected students 
would find the course to become slightly 
more difficult as they progressed through 
to the latter stages, (reflected in responses 
to Question 2 of the evaluation) the stu- 
dents maintained a high level of interest 
throughout the course, shown in the re- 
sponses to Question 1 of the evaluation. 

Results for all sections of Question 3 illus- 
trate the students' support for the self- 
id 
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paced instructional package the> were 
required to use, particularly in the first 
three modules evaluated. The results for 
the last three modules still reflect students' 
strong support, yet reflect the increasing 
difficulty they must have experienced as 
they progressed through to the more diffi- 
cult concepts. 

Questions 4 and 5, dealing with the appro- 
priateness of the assessment items and the 
services provided by the DDIa % illustrate 
a high level of support for the computer 
based assignments, and the associated 
marking procedures including the ex- 
tended feedback provided. 

The final question asked of students related 
to the number of hours spend on a particu- 
lar module. If you take into account the fact 
that Modules 2, 3 and 4 encompass three 
units in the set text, and 5 and 6 two units, 
the average number of hours per unit in the 
text range from 6.55 hours for units in 
Module 2 to 14.18 hours for units in Module 
6. These are encouraging results as it is 
stipulated that the average time required to 
be spent per unit should, on average, be in 
the vicinity of 8-10 hours. 

As stated earlier, discussion on the effec- 
tiveness of the course based on pass rates is 
at present limited. While tentative conclu- 
sions that the course is achieving satisfac- 
tory results can be made, statistics need to 
be finalized after the initial enrolment 
population of 1986 and 1987 have com- 
pleted their attempts at the course. 

Conclusions 

In a course with a current active enrolment 
of over 400, which has had over 2000 as- 
signments processed during the last 18 
months, and a course with only three part- 
time tutors, thecost-effectivenessand time- 
efficiency of running the course as a com- 
puter based education package is self-evi- 
dent. Coupled with the positive response 
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from student evaluation, and the emerging 
success patterns of individuals who com- 
plete the course, it would appear the course 
is successfully meeting its two main objec- 
tives as outlined at the beginning of the 
paper 

However, there are still important issues in 
the evaluation of the course which are cur- 
rently under examination, r*nd need to tx, 
finalized before a complete evaluation of 
the course can be tabled. With the introduc- 
tion of the interactive micro-computer 
based assessment in 1983, and with the 
completed statistics of the 1986 and 1987 
student populations, it will be possible to 
instigate additional evaluation as to the 
effects on students, and the efficiency of 
the various modes of assignment process- 
ing. More specifically, it will enable 
insight into issues related to the utiliza- 
tion of computers in the delivery, proc- 
essing and monitoring of course material 
on a large scale. 
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APPENDIX A 



ASSIGNMENT 1A: MODULE 1 -SPIM UNIT 1 



This assignment is to be a computer marked test containing both exact answer and multiple- 
choice questions You should place your answers on the answer sheet mmediately following 
this assignment. 

Answer all questions in the format requested, and pleas* note that if an answer is negative 
you must remember to include a W - H before the value. If your answer is positive to not place a 
*+" before the value as it is not required. All answers for this assignment should be in 
integer and/or fraction for.n, and if you should obtain an answer which includes both an 
integer and fraction value, it should be placed on the answer sheet in the following form 



"3 — " would be wntvCn 



□□□□□ 



vhere is tho "and" symbol. If too many boxes are supplied for a particular answer 
remember to leave the end boxea blank. 



Appendix A: (continued on page287) 
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Question 




Mod 


Mod 


Mod 


Mod 


Mod 


Mod 


! — 


1 


2 


3 


4 


5 


6 




1 . I found the module 


M 


1.74 


1.80 


1.81 


1.92 


1.79 


1.83 


interesting. 












14 


12 


N 


167 


86 


43 


27 




SD 


0.47 


0.40 


0.46 


0.62 


0.58 


0.58 


2. The module was 


M 


1.78 


2.32 


2.32 


2.84 


2.71 


2.92 


easy to follow. 












14 




N 


176 


75 


47 


25 


12 






0 . 73 


0 . 62 


0.63 


0 . 75 


0.89 


1.00 


TVt tjrftsftntption 


M 


1.78 


1.89 


1.88 


2.07 


2.07 


2.17 


J. Ultw US \y \Ji \A. ± w 












14 


12 


including ' 


N 


160 


71 


42 


27 


- formative 


SD: 


0.50 


0.43! 


0.40 


0. 68 


0.83 


0.83 


assessment 
















items 
































learning. 
















3B.The presentation 


M 


1.77 


2.00 


2.00 


2.33 


2.14 


2.5 


of the module 












14 


12 


including: 


N 


163 


73 


42 


24 


- directions to 


SD! 


0.54, 


0.471 


0. 49, 


0.71! 


0 . 86 ! 


1 . 00 


read 
















assisted ray- 
















learning. 


! 












— — — — • 


3C.The presentation 


H 


1.68 


1.75 


1.83 


2. 15 


1 . 92 


2. 33 


of the module 














1 9 


including: 


N 


165 


73 


4 i 


do 


1 o 

JL vr 


- Study Book 


SD 


0. 50 


0 . 52 


0 . 44 


0.47 


1 . UU 




assisted my 
















learning. 
















3D. The presentation 


M 


1.82 


1.92 


1.95 


2.23 


2.07 


2.08 


of the module 










26 


14 


12 


including: 


N 


154 


73 


39 


- statements of 


!SD 


0.47 


1 0.43 


0.51 


! 0.65 


! 0.73 


! 0 51 


objectives 
















assisted my 
















learning. 
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Question 




! Mod 


! Mod 


! Mod 


! Mod 


! Mod 


! Mod 




• — 


< i 
i *■ 


* *> 


• *\ 




1 O 


i o 






1 9 1 1 


• 9 nn 




1 JL . OO 




• 9 on 

\ Cm . UU 


of +hft mnHn 1 ft 
















no! iirfi v\& i 




i ' « 






1 1 ^ 

1 •*■ 


i ^ 


K 

1 *s 




I ox/ 


1 0 74 


1 0 48 




1 n 4Q 
i \j . t%j 


1 fi R4 


1 1 nn 


contact 
















asaisiea my 
















learning. 






1 








' 


3F.The presentation 


1 

H 


! 1.67 


! 1. 74 


! 1 . 74 


\ 1. 89 


! 2. 14 


( 2. 08 


of the mod ul© 
















including: 


IN 


: i6o 


! 72 


! 39 


! 27 


i 14 


12 


- pretest 


SD 


0.57 


0.50 


0.55 


0. 50 


! 0.86 


0.79 


assisted idv 
















learning. 
















3G.The presentation 


M 


1.68 


1.70 


1.74 


! 2.25 


! 2.21 


2.00 


of the module 
















including: 


H 


161 


73 


39 


27 


14 


12 


- set cext 


SD 


0. 54 


0. 54 


0.55 


0. 81 


0.80 


0. 74 


assisted my 
















learning. 
















4 . The assessment iteir 


M 


1.77 


1.78 


1.67 


1.92 


1.78 


1.83 


is a fair test of 
















my attainment of 


N 


164 


77 


42 


27 


14 


12 


objectives in this ; 


SD. 


0.52! 


0.45 


0.47! 


0.62 


0.42; 


0.39 


module. 
















5. External studies | 


M ! 


1.81| 


1.94; 


1.94! 


2.05 


1.92! 


1.89 


facilities 
















provided by DDIAE j 


N ; 


155 ! 


68 ! 


34 i 


21 ! 


13 


12 


were adequate for 


SD| 


0.52! 


0.52! 


0.42! 


0.66 


0.49! 


0.78 


studying this ! 
















module. ! 
















6. I spent approx. j 


M ! 


8.03! 


19.651 


27.471 


37.48! 


28.33' 


28.36 


hours on this ! 
















module. i 


N ! 


162 j 


68 ! 


38 ! 


25 J 


12 ! 


9 




SD| 


5.96! 


10.86! 


16.73! 


27.97! 


23.76! 


24.54 



Table 1: (continued) 




Using Computers Intelligently 
QUESTION 1 

Which of the following are the prime factors of 180? 
(Select the correct option.) 

1. 2X2X3X3X5 

2. 4X5X9 

3. 1 X 180 

4. 3 X 3 X * c 6 

QUESTION 2 

Evaluate 3 ■4.3 1/,; (3°X3 3/4 ) 2 + 3 2 
QUESTION 3 



Which of the following is the correct simplification of 




(Se ! ect the correct option.) 



1. 




2. 



a 



ab 



3. 



4. 




QUESTION 4 



Solve the equation 4t-10 = 2t-9 
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QUESTION 5 

(\ 4\ /l x2 

Evaluate - + 2 + 6+ - X2- - 

V 3 6 / V 3 

QUESTION 6 
Simplify 27" 1 ' 3 

QUESTION 7 



12 3 3ab 

If a = - , b = - and c = - find what equals. 

3 5 5 2bc 



QUESTION 3 

Solve for x: 3x + 7 = x + 1 1 
QUESTION 9 



1 3 1 
Solve fort: - + — +4 = 7- — 
t 2t 2t 



QUESTION 10 

Which of the following is the correct simplification of x'*y(x 4 z + xy 3 )? 
(Select the correct option ) 

1. x 7 y 4 z 

2. x" 2 yz + xy 2 

3. x 6 + yz + x 3 + y 4 

4. x 6 yz + x 3 y 4 
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Place your assignment sticker here 



ANSWER SHEET 



FOR OFFICE 
USE ONLY 



TEST 1 1 032 - Assignment 1 A 



DUE DATE Week 2 



Please remember that you must include a if your answer is neg?tive but do not include a * + * if it 
is positive. If too many boxes are supplied for a particular answer le&ve the end boxes blank. 



1. 



4. 



6. 



10. 



□ 

□ □□□□ 
□ 

□□□□□ 
□□□□□ 
□□□□□ 

□ □□□□ 

□ □□□□ 
□□□□□ 
□ 



21) 

22-1:26) 
27) 



28-1 
33-1 
38-1 
43-1 
48-1 
53-1 



32) 
37) 
42) 
47) 
52) 
57) 



(1.58) 
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UNIT : 11032 01 X : UPDATING MATHEMATICAL SKILLS 
ASSESSMENT ^ ? ^^^ 83 : DIAGNOSTIC QUIZ 



MR PETER 
P 0 BOX 
ROMA 
QLD 
4455 



STUDY BOOK: 

Page 55 - Equation 7 should read a = 10 

Page 49 - Answer to Question 1 DOES NOT include "-1, -2, -3, etc. 

and zero" as natural numbers on ly contain the counting 
numbers : 1 , 2 , 3 , etc . 

Page 97 - Reference page in text for 'Factorial n' is page 93 of 
TEXT BOOK: 

Page 32 - Exercise 2.4, No. 1A: Interval should read: 1-3,5) 

No. IB: Interval should read: (-1,11 

Page 39 - Point Q co-ordinates should read (-1,1/2) 

Page 46 - Formula for "d" following figure 3.13 should finish 
with M (y subscript 2 minus y subscript 1) squared" 

Page 49 - Exercise 3.6, No. 3: should read: y»-0.15x 

Page 67 - 2nd example at top of page should read: E=I2,4,6...} 

Page 121- Top of page should read "Exercises 6.6" 

Page 148- Figure 7.21 is incorrectly labelled. Function should 
read "inverse function = 1/x," not "x+2" 

Page 171- In Figure 8.6, the functions all cross the y-axis at y*l, 
the graph has the position of 1 on the y-axis marked 
incorrectly . 

Page 184- Figure 9.6. Hypotenuse should be "square root of ?" . 

Page 186- Figure 9.11. Point on x-axis should be labelled "-1". 

Page 326- lb Answer should be preraced with "1/3". 
•END 
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- a statement as to correctness/validity of the response 

- feedback is provided where appropriate 



QUESTION 


RESPONSE 


RESULT 


1 


♦ 12 


CORRECT 


2 


-7 


CORRECT 


3 


-1 


CORRECT 


4 


+ 4 


CORRECT 


5 




NOT ATTEMPTED 


6 


+ 125 


CORRECT 


7 




NOT ATTEMPTED 


3 




NOT ATTEMPTED 


9 




NOT ATTEMPTED 


10 




NOT ATTEMPTED 


11 


+ 1/2 


CORRECT 


12 


+ 29 


INCORRECT 


13 


+ 7 


CORRECT 


14 


+ 10 


CORRECT 


15 




NOT ATTEMPTED 


16 




NOT ATTEMPTED 


17 


+ 1 


CORRECT 



Question 5 



The correct answer is -1/15 because 

(-1/5) x (-4/3) - 1/3 = (-1/5 x -4/3) - 1/3 

= 4/15 - 1/3 
- 4/15 - 5/15 = -1/15 



Question 7 



a'^/a** is eruaJ to a*/a* = a»a«a/a * a 3 
Therefore t a final power of "a" = +2, 



Question 8 



a a b- a /a-»bc = a a .a*/b.b a c - a a /b*c * a a b- 3 c- A 
Therefore the final power of "a" = +5, 



Question 9 



a a b- a /a-*bc = a a .a*/b,b a c = a B /b a c = a»b-*c- x 
Therefore the final power of "b w * -3. 



Question 10 



a a b- a /a-*bc * a 3 ,a a /b.b 3 c = a«/b a c * a»b" 3 c-* 
Therefore* the final power of "c* - -J. 



Question 12 



Remembering the correct order of operations, the solution is 
(16 * 2 3 + 3 a x 2) ♦ 2 ♦ 4 a = 
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(4 + 18) + 2 + It » 
22 ♦ 2 ► 16 = 
12 ♦ 16 = + 27 



Question 15 



The correct solution la: 

yz/2x = (4/3»2/5)/<2»l/3) = < 8/1 5 > / < 2/3 > ^ 
8/15 • ?/2 = 24/30 = +4/5 



Ques.ion 16 

The correct solution is: 

4x + 7 = 5x + 4 
4x - 5x « 4 - 7 
-x = -3 
x = +3 



Number of questions : 17 

Number answered correctly : 9 

Number answered incorrectly : 1 

Number with answer missing : 7 

Number with invalid answers : 0 

Score ( % ) : 52.9 



You have scored between 50% and 70% on the diagnostic quiz which 
suggests that while a little rusty, you have a reasonable 
understanding of the fundamentals of mathematics. Please feel free 
to contact D.E.C.E. should you have any outstanding queries on the 
diagnostic qui^ . If you have no queries you should now begin 
studying Module 1. 
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APPENDIX C 



ASSIQN06.PUB.SE 04/AUG/87 19:02 PAGE 49 

DARLING DOWNS INSTITUTE OF ADVANCED EDUCATION 
UNIT ASSESSMENT REPORT 



86 11032 UPDATING MATHEMATICAL SKILLS 01 X 
D86410XXX MR MAURICE X (CONFD: 



AS 


01 


ASSIGNMENT 


1A 


S 


AS 


02 


ASSIGNMENT 


2A 


Z 


AS 


03 


ASSIGNMENT 


3A 


S 


A8 


04 


ASSIGNMENT 


4A 


S 


AS 


05 


ASSIGNMENT 


5A 


S 


AS 


08 


ASSIGNMENT 


6A 


S 


AS 


07 


DIAGNOSTIC 


Quiz 


s 


AS 


08 


ASSIGNMENT 


IB 


s 


AS 


09 


ASSIGNMENT 


1C 


s 


AS 


10 


ASSIGNMENT 


2B 


s 


AS 


11 


ASSIGNMENT 


2C 


s 


AS 


12 


ASSIGNMENT 


3B 


s 


AS 


13 


ASSIGNMENT 


3C 


s 


AS 


14 


ASSIGNMENT 


4B 


6 


AS 


15 


ASSIGNMENT 


4C 


S 


AS 


18 


ASSIGNMENT 


5B 


s 


AS 


17 


ASSIGNMENT 


5C 


8 


AS 


18 


ASSIGNMENT 


6B 


S 


AS 


19 


ASSIGNMENT 


6C 


S 



RECD 

09MAY86) 
18JUL86 
3 SSEP86 
292EP86 
160CT86 
27NOV86 
11 DEC 8 6 
09MAY86 
♦O'DUE* 
*0'DUE* 
♦O'DUE* 
♦O'DUE* 
♦O'DUE* 
♦O'DUE* 
♦O'DUE* 
♦O'DUE* 
21JAN87 
*0 * DUE* 
21JAN87 
♦O'DUE* 



RETD 



23JUL86 
17SEP86 
03OCT86 
220CT86 
05DEC86 
15DEC86 
19MAY86 



RESULT 



50/ 
73/ 
70/ 
66/ 
30/ 
30/ 
58/ 



23JAN87 100/ 
23JAN87 90/ 
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ASSIGNMENT 
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10 


ASSIGNMENT 
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11 


ASSIGNMENT 
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12 


ASSIGNMENT 


3B 


s 


13 


ASSIGNMENT 


3C 


s 


14 


ASSIGNMENT 


4B 


s 


15 


ASSIGNMENT 


4C 


s 


16 


ASSIGNMENT 


5B 


s 


17 


ASSIGNMENT 


5C 


s 


18 


ASSIGNMENT 


6B 


s 


19 


ASSIGNMENT 


6C 


s 
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1C 
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17 
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65 
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11 


0 


0 


7 


23 
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0 


6 


57 
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0 
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28 
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5 
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0 


3 


28 
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3 


100 


152 


150 


2 


0 


0 


1 


31 


2 


100 


152 


150 


2 


0 


0 


1 


31 


2 


100 


152 


151 


1 


0 


0 


0 


65 


1 


100 


152 


150 


9 


0 


0 


1 


31 


2 


100 


152 


151 


1 


0 


0 


0 


65 


1 


100 


152 


149 


3 


0 


0 


1 


97 


3 


100 


152 


151 


1 


0 


0 


0 


65 


1 


100 
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ATTENTION Michael Crock, D.E.C.E. 
OPINIONNAIRE Course 11032 Module 1 

Please return this to the Administrator, D.E.C.E., with Assignment 1. 

Tick the box which best describes your reponse to the statements made and add any 
comments you wish to make. Further specific comments on how the module/course could 
be improved are welcomed and should be added overleaf or on attached sheets. 



.r on gly agree 
agree 

din agree 

strongly disagree 



1. I found the module interesting. 
Comment*: 



2. The module was easy to follow. 
Comments; 



3. The presentation o7the module including: 
- formative assessment items 



- directions to read 

- Study Book 

- statements of objectives 

- telephone contact 

- pretest 

- set text 

Comment*: 



assisted 

my 

understanding 



objectives in this Module. 
Comments: 
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□ 

1 


□ 

2 


□ 

3 


□ 


□ 


□ 


□ 


□ 


1 

□ 


□ 


□ 


4 

□ 


1 

□ 


2 

□ 


3 

□ 


□ 


1 

□ 


3 

□ 


3 

□ 


" 4 

□ 


1 

□ 


□ 


3 

□ 


4 

□ 


□ 


2 

□ 


3 

□ 


4 

□ 


1 

□ 

1 


2 

□ 


3 

□ 


4 

□ 

4 


□ 


□ 


□ 


□ 



H.ta; 



please continue over 
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5. External studies facilities provided by DDI AE were 
adequate for studying this module. 

Comments; 

$. I spent approximately [~ | | hour on this module. 
Comments: 

7. I would improve the module by 



Thank you 
Michael Crock 




strongly agre-e 
agree 



c 



disagree 



strongly disagree 
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Are computers the write stuff? Computers 
and writing instruction 



Marsha Durham, School of Humanities and Applied Social 
Sciences, Nepean College of Advanced Education 



A variety of computerized writing aids exi9t, eg for 
topic exploration/ spelling and grammar checking, 
style analysis and word processing. Educators may 
consider the aids unproblematic and even desirable 
in composition instruction, especially as students' 
enthusiasm for them seems to ensure their success. 

Trie effect of these 'writer's helpers' on students' 
writing has not been thoroughly studied Prelimi- 
nary studies suggest that the computer may be of 
limited value. Writing is both individual and recur- 
sive, and programs based on a superficial or pre- 
scriptive view of writing cannot duplicate the com- 
plex choices that writing involves. 

To effectively use computers in writing instruction, 
educators must be prepared to act as mediators be- 
tween students and technology, by (1) helping stu- 
dents move from the limitations of these programs to 
expand their own choices in writing, and (2) working 
with technical experts to create programs that incor- 
porate sound educational objectives. 



Two major problems have weakened much 
of the research about the effect of comput- 
ers on students' writing: conclusions based 
on insufficient or biased data; and reliance 
on anecdotal evidence as 'proof. In addi- 
tion, the overly enthusiastic tone of many 
articles about computers and writing pro- 
motes uncritical acceptance: 

You've written several late passes ... 
for students too involved in their work 
to leave ... (Y)ou lock your door 
against a roomful of students working 
after school. You arrive home only to 
receive phone calls from students too 
interested in their assignment to wait 
until class ... Experiencing such ram- 
pant student enthusiasm is a rare and 
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isolated phenomenon for an English 
teacher. It is however, a commonplace 
experience for a computer teacher! 
(Leonardi and McDonald,l*87, p. 45) 

The computer's abilities for writing assis- 
tance are appealing, as it can provide lay- 
outs, previews, spelling checks, style 
analysis and grammar instruction, as well 
as perfect presentation. Yet, as with any 
technology introduced for educational 
purposes, computerized aids for writing 
should be evaluated on their ability to 
support pedagogical objectives. Many 
problems surround die technology, with 
some programs presenting inappropriate 
procedures and criteria as part of their 
writing instruction. In this paper, I will 
focus on the impact that writing programs 
have on student writers, and comment on 
their effect in changing students' writing 
processes and their interactions within the 
writing class. 

Views of the zvriting process 

Although often taught as separate stages, 
the major cognitive processes in writing — 
planning, translating, reviewing and 
monitoring — can be implemented at any 
point in one's writing (Sommers, 1985, p. 
5). Writing is recursive, with writers re- 
peating their processes from first idea 
through to finished product. For example, 
although editing is often thought of as a 
final action, it also happens before and 
during one's writing. 

0 6 
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Writing is situationally based, dependent 
on such variables as one's interest and 
knowledge of a topic, perception of audi- 
ence, past successes in writing, subject 
limitations and time constraints. As well, 
writers have different, individual writing 
styles. 'Mozartians', for example, make 
extensive outlines, mentally or on paper, 
before writing a comprehensive first-final 
draft. Another type, the Ueethovians', 
favor writing a quick, rough draft, then 
revising extensively, perhaps arriving at a 
clear pattern only late in the process. 

Recent composition research (Berthoff, 
1981; Stock, 1983; Beach & Bridwell, 1984; 
Rower, 1985; Knoblauch & Brannon, 1984; 
Tate & Corbett, 1981, Hillocks, Jr, 1986) 
supports the view that writing is more than 
just exhibiting one's learning. It is a way of 
learning, for our meaning evolves as we 
make choices in our writing. Unfortu- 
nately, choices diminish when students 
wrlce, as they manufacture 'Engfish' (see 
Reference Note 1), ie lifeless writing which 
has lost its ability to 'speak' to readers. 
'Engfish' results when students are are 
unable or uninterested in ensuring that 
their meaning is reciprocated by the reader. 

Can computers play a constructive role in 
teaching students to write for meaning? 
Most computer writing programs offer 
only limited assistance in teaching the 
complex choices that good writing in- 
volves. While useful for specific purposes, 
these programs can be damaging if they are 
introduced as comprehensive tools, with 
students expected to curtail their writing to 
use the program. 

Computerized heuristics 

Academia's emphasis on evaluation, style, 
grammar and punctuation may cause stu- 
dents to 'freeze' in their thinking, and ex- 
plore only the safest ideas. Instead, stu- 
dents need to be encouraged to experiment, 
in order to discover what they want to write 
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about, what they know about the subject, 
and what they must research: 

The first use of language that a student 
of composition has to learn. ..is in the 
generation of chaos .If we don't begin 
there, we falsify the composing proc- 
ess because composition requires 
choosing all along the way, and you 
can't choose if there are no perceived 
alternatives: chaos is the source of 
alternatives. If we are unwilling to risk 
chaos, we won't have provided our 
students with the opportunity to dis- 
cover that ambiguities are, as LA. 
Richards has said, 'the hinges of 
thoughf . (Berthoff,1981: 75) 

Too often students curtail thinking too 
early, neglecting to generate choices, eg 
ideas, questions, inconsistencies, problems 
and qualifications. Researchers believe 
that one major difference between good 
and poor writers is their ability to possess 
and select different heuristics: "Good writ- 
ers not only have a large repertory of 
powerful strategies, but they have suffi- 
cient self-awareness of their own process to 
draw on these alternative techniques as 
they need them" (Flower, 1985, p. 37). 

Computers can help in teaching heuristics. 
Programs have been written for the most 
popular types, eg freewriting, brainstorm- 
ing, tagmemics, treeing, Aristotle's topoi, 
Burke's dramatistic pentad, and discovery 
questioning, as well as for specialized writ- 
ing topics, eg narration, argumentation, 
poetics and fictional characterization. 

Computerized heuristics can help students 
who are unsure about their ideas, and who 
might not speak up in a class dicussion 
about topics. The dialogue format of some 
heuristic programs encourages students to 
go beyond their commonsense under- 
standing to consider different aspects of a 
topic, and amass more significant and 
thoughtful information. The program can 
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also point out where they lack sufficent 
knowledge. Students introduced to a wide 
repertory of invention strategies may learn 
to be more flexible in choosing ways to 
explore ideas according to a particular 
writing task* Brainstorming, for example, 
rpay work for a short creative writing piece, 
while a different heuristic may be more 
suitable for a lengthy research report. 

Using these programs can create problems. 
If only one heuristic is available, students 
may have the mistaken view that it is rele- 
vant for every writing task. Students may 
become overly dependent on software, 
and wait passively for cueing. Some pro- 
grams may be so complicated that students 
cannot relate them to their assignment* 
Others may alienate students by using a 
lock-step approach, or an inappropriate 
tone of response. And, on their own, heur- 
istics programs will not overcome, stu- 
dents' writing apprehension or their pre- 
occupation with 'regurgitating 7 the 
lecturer's ideas. By undermining students' 
interest in human feedback, programs may 
isolate students from perceiving their writ- 
ing as a meaningful, communicative act for 
others. 

Educators can thoughtfully integrate a 
heuristics program into the writingclassby 
pointing out its immediate and long-term 
advantages and disadvantages, or by com- 
paring responses of the program with those 
of a real audience. They can ensure that 
students do not rely on the program for all 
their writing, but incorporate responses 
from others, as well as think up their own 
questions in considering their topic. This 
critical approach allows students to under- 
stand the program's limitations, and the 
value cf knowing and using a variety of 
methods in assessing a topic. 

Impact of word processing 

Researchers interested in the writing proc- 
ess have usually relied on the subjective 



method of having writers describe their 
composing habits, either as they write, or in 
retrospect. Studying students' modes of 
writing is even more difficult because of the 
negative influence of having topics as- 
signed, and the finished work evaluated. 
Despite breakthroughs in research (see 
Reference Note 2), not enough is known 
about writing processes to adequately 
evaluate the impact of computer use. 

The hardware and software is so often se^n 
as beneficial, that it is difficult to consider 
that both can have a detrimental effect on 
students' writing. For example, word proc- 
essing offers 'clean copy 7 by immediately 
incorporating changes. Seeing their first 
draft perfectly displayed can give students 
a false sense of its importance, and thus 
undermine the value they perceive in re- 
flecting on their work, and editing it. Not 
being able to refer to their original and 
subsequent drafts may rob students of a 
sense of achievement. Resurrecting dis- 
carded information is impossible with 
some programs, yet this is often necessary 
when the writing takes a new direction. 

Computer hardware can also inhibit 
student's writing. A mouse, for example, 
may still be more cumbersome than a pen- 
cil, and therefore editing with it is avoided. 
The computer screen, which allows only a 
limited view of one's work, makes it diffi- 
cult to assess overall movement. Com- 
mands like 'scroll' and 'find', and features 
like split screens and clipboards,are help- 
ful, but these still do not allow the simulta- 
neous viewing of major sections that some 
writers may need. The screen may prevent 
interaction, as students stayed 'glued' to 
their work. And, it can inhibit trials and 
other types of experimenting, because it 
creates a 'public' display of one's work. 
Even seeing one's work in an electronic 
format can be alienating, as one student 
found: ''It's awfully hard for me to look at 
the screen and want to edit anything. My 
paper seems so far away, almost abstract" 
(Harris, 1985, p. 327). 
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Absence of definitive knowledge about 
computers' influence on writing has not 
prevented some educators from assuming 
that students who use word processing not 
only write more, but edit more signifi- 
cantly. Preliminary research, however, 
suggest that students do not fully utilize 
theeditingfunctions in word processing. A 
recent study indicated that although ob- 
served students believed that they revised 
more on the computer, they did not. In 
addition, changes made were mainly mi- 
nor, eg "adding a tew details, rearranging 
words within a sentence, substituting one 
word for another of essentially the same 
meaning, deleting a word or phrase, etc ' 
(Harris, 1985, p. 328). 

In surface revision, the computer is only a 
'glorified typewriter', used to transcribe 
handwritten work, correct surface errors, 
and make attractive pages. Significant revi- 
sion, on the other hand, includes making 
"semantic and rhetorical changes that af- 
fect the content and organization of a piece 
of discourse" (Harris, 1985, p.323). Writers 
revise significantly when they concern 
themselves with making their prose 
reader-based : they actively test their 
meanings and gauge their readers' com- 
prehension. Students who are writer- 
bast ' believe that it is sufficient if their 
writing is clear to them, unaware that 
meanings are not so easy to establish: 

The making of meaning is a dialectical 
process determined by perspective 
and context. Meanings change as we 
think about them; statement and 
events, significance and interpreta- 
tions can mean different things to dif- 
ferent people at different times. Mean- 
ings are not prebaked or set for all 
lime; they are created, found, formed, 
and reformed. (Berthoff, 1981, p. 71) 

In creating meaning, the computer can be 
useful, as it allows experimentation: ideas 
can be developed, erased, or put on 'hold'. 

: ERJC 



Once students view the computer as a good 
'trialler', that can easily clean up false 
starts, weak writing, and undeveloped 
sentences, they may move naturally to sig- 
nificant revision. 

Text graders 

A full-time composition instructor in an 
American college writing program may 
mark over 350 assignments in a 10 -week 
term. Consequently, interest has been keen 
in computerized text grading, which al- 
lows educators to flag common mistakes 
and leave the program lo provide detailed 
explanations to students. 

What is the pedagogical worth of 'Jus soft- 
ware? Educators may dsnde that the 
computerized grader proviaes extensive 
information while freeing them to concen- 
trate on global comments. An instructor 
can mark 'CS' on an assignment, for ex- 
ample, and leave the program to define 
'comma splice' to the student, and suggest 
exercises related to this error. 

The drawback to the program's ability to 
pinpoint errors is that it may encourage 
lecturers to flag every mistake, in content, 
style, grammar, spelling and punctuation. 
Not only do they then spend more time 
marking, but such intensive correction 
maybe counter-productive. Students may 
see the lecturer's comments as little more 
than "mutilations of their work and intru- 
sions into their ideas", and believe that the 
comments show that "they haven't ex- 
pressed the approved opinions" ( Sudol, 
1985: 333). 

In addition, students often have little 
understanding that the lecturer's com- 
ments are to aid them in their future work. 
Consequently, composition researchers 
are becoming interested in the value of 
checking work in progress, rather than 
finished pieces. Instead of reading for 
mistakes, the lecturer's interest must nec- 
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essarily shift to searching for intended 
meaning, attempting "...the dialogue that 
has been formed in the writer's mind, 
transformed in his dialogue on paper" 
(Berthoff, 198139). Surface errors are ig- 
nored until the student learns how his or 
her intended meaning has been under- 
stood. 

One objection to this idea is the amount of 
time taken to read several drafts. Propo- 
nents suggest, however, that intervening 
earlier in the writing process saves one 
from reading lifeless, inaccurate essays. 
Students can be taught how to give valu- 
able comments on others' work, and their 
analysis can be followed by computerized 
checks for spellingand grammar. The final 
product, accurate and edited, allows the 
lecturer to read it without having to com- 
bine the role of critic with that of proof- 
reader and editor. 

Checkers 

Software exists that can check text for spell- 
ing, grammar, punctuation, word usage, 
and style. The expectation is that the infor- 
mation produced will help writers under- 
stand their weak points in a work, and 
revise. In advanced or specialized writing 
classes, eg technical and professional writ- 
ing, this information can be valuable, estab- 
lishing standards of 'correct 7 writing. For 
general writers, it may be detrimental 
unless students understand the program's 
limitations. 

For example, spelling programs, by freeing 
poor spellers from having to concentrate on 
mistakes, create new interest in writing. 
Most spelling checkers, however, have 
vocabulary lists too limited for tertiary 
level writing, and these would need to be 
augmented for students' use. 

As grammar and punctuation is complex 
and inextricably related to context, check- 
ers for these elements are usually inappro- 



priate, because they rely on simplistic, 
prescriptive statements or rules. In one 
program for younger children, for ex- 
ample, the check consists of asking the 
writer the same general question for each 
sentence:" Are you using punctuation cor- 
rectly?", "Is this a good 
sentence?"(Smithson, 1987: 88). Students 
needing the check program probably 
would not be able to answer these ques- 
tions. 

Style checkers pit one's written work 
against a prescribed readability formula. 
Researchers have already questioned the 
worth of using formulae,originally created 
to check the reading level of textbooks, as a 
standard for evaluating other types of writ- 
ing. Readability formulae suggest that 
word length, sentence length, abstractions, 
and other stylistic features constitute the 
work's level of comprehension, and there- 
fore its worth. These features are inherent 
features of writing, but it does not follow 
that obeying the program's suggestions 
will automatically produce good writing. 

While readability formulae may be useful 
to professional writers, students may find 
that the analysis of their writing is pre- 
sented in an almost indigestible format. 
They must be taught how to translate the 
evaluation into specific strategies for im- 
proving their writing, if the program is to 
be useful. 

Future development of witing 
programs 

Students need direction in understanding 
what may be wrong with their writing. But 
the choices that they make are within the 
context of each specific rhetorical situation 
for which they write. The program that can 
take account of all the variables in those 
situations has yet to be created. 

In the future, valuable programs for writ- 
ing, would be sophisticated packages in- 
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corporating all 'stages' of the writing proc- 
ess. For example, students could concen- 
trate c shifting from a writer-based to a 
reader-based view as they revise if they 
could use a simple heuristic/ word process- 
ing program that asked them to answer 
questions about their topic, enter their first 
draft, then answer further questions about 
how they had developed their ideas. Such 
comprehensive writing programs have 
already being developed, but are still lim- 
ited for full classroom use. 

"Engfish" may stem from students opting 
for the first, easy response to a topic. If 
students could select from a variety of 
heuristics on one disk, they might be en- 
couraged to explore not only more possi- 
bilities within the topic, but also learn what 
heuristic style most suits them. Another 
helpful program would be one that assists 
students in selecting their own topic, based 
on analyzing their knowledge, interests 
and abilities. 

Graders and checkers are reasonable inclu- 
sions in writing instruction, if they include 
further information and exercises for stu- 
dents who wish to work on specific writing 
problems. If these Itelp' items incorpo- 
rated longer passages of text, not just iso- 
lated sentences, students would learn how 
to spot problems in 'real-life' prose that 
they read. Drill-practice programs in 
grammar, punctuation, and spelling have 
lost their popularity, but they may offer a 
non-threatening way of providing encour- 
agement and revision of basic writing skills 
to particular types of students, eg mature- 
age students enrolling after a gap in their 
formal education. . 

Conclusion 

Educators interested in computersfor writ- 
ing should be aware of more than the tech- 
nical aspects. The cognitive and psycho- 
logical aspects of writing lead educators to 
question the worth of 'writers' helpers' that 
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use out-moded prescriptive models, are 
overly difficult to use, encourage a 'piece- 
meal' approach to writing, or focus too 
stringently on errors. 

Before any computerized writing program 
is introduced, the technology should be 
evaluated to see what benefits it offers to 
students' writing and to ensure that inap- 
propriate learning experiences are not 
being designed to fit the software. Instead, 
software that teaches students to expand 
their writing choices, and to understand 
and explore their methods, will allow stu- 
dents to see technology as a help, rather 
than another hurdie in what may too often 
be seen as the 'mystery* of good writing. 

Educators can also assess their ability to 
mediate between the program's operating 
methods and students' educational needs. 
Integrating programs with the course's 
educational objectives, includes consider- 
ing how the technology will affect educa- 
tors' teaching methods, classroom interac- 
tions, and other commitments. More writ- 
ing educators are writing their own com- 
puter programs, basing them on the grow- 
ing body of knowledge and research about 
the writing process. As computers become 
more sophisticated, perhaps writing spe- 
cialists and technical experts v/ill collabo- 
rate to develop advanced, comprehensive 
programs that can accept numerous op- 
tions and choices, and thus allow students 
to be truly supported by computers as they 
experiment in creating reciprocated mean- 
ings in their writing. 

Appendix A: Computer 
Programs for Writing 

Prewriting 

1. QUILL Planner 
Apple 

Prompts by keywords, title, author, entry 
numbers, topic 
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2. Narcissus & Echo authoring system 
Reads list of questions into an invention 
program 

3. SEEN 
Apple 

Prompts for fictional character analysis 

4. TOPOI 

DEC, Apple, IBM PCPrompts for pur- 
poses regarding subject topic 

5. Pre write 
Apple 

Prompts for fictional/personal prose, or 
expository prose, then suggests 
free writing 

6. Interaction 

Bulletin board programs for posing 
questions to class or creating database of 
questions. 

Comprehensive; Specific 

1. Writing Workshop 
Apple 

Grades 3-10 

includes word processor, Prewriting 
(brainstorming, branching, nutshelling), 
Postwriting (checks mechanics, spelling, 
and proofreads) 

2. Poetics 
IBM 

Tutorials, exercises and authoring system 
for teaching prosody at tertiary level 

3. The Poetry Processor: Orpheus A-B-C 
(not available as of Feb 1986) 

4. WARP 

Includes drafter, editor, outliner, printer, 
utilities 

(being developed) 

5. Writer's Helper 

programs including creation , analysis 
(readability), revision 



Revising and Text analysis 

1. ALEXIS 
(Dutch program) 

error description and correction at 5 
levels 

2. Catch 
Apple 

Grammar and style diecking, plus 
prompts for revising 

3. CRITIQUE (formerly EJISTLE ) 
IBM 370 

Detects 14 classes of syntactic errors in 
sentences, eg 'who' for 'whom', subject- 
verb disagreement, improper verb form. 
Directed to office correspondence 

4. Grammatik 
CP/M, IBMPCTRS~80 

Prompts for errors in capitalization and 
punctuation, identifies sexist language, 
and trite or wordy phrases, and gives 
sentence and word length. 
Includes visual aids /spreadsheets/ 
printouts possibly used by technical 
writing students for reports. 
Has audible on-going spelling check. 

5. Homer 
Apple 

Isolates prepositions, 'to be' verbs and 
imprecise words, and gives sentence 
lengths and word types. 

6. Punctuation & Style 
CP/M, MS-DOS 

Checks punctuation errors, unpaired 
format commands, double words, passive 
voice, misused/overworked phrases 

7. Style 

Includes Bias, which calculates ratio of 
female to male pronouns, plus flags 
sexists words and phrases. 

8. Unnamed 

Prof. B Broughton & W Horn, Clarkson 
University 
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program that flags libelous and slander- 
ous statements. 

9. Styled, Styllist 
IBM 

Checks long words, punctuation, 'struc- 
ture 7 words, forms of 'to be 7 , norminaliza- 
tions. 

10. Writer's Workbench 
UNIX 

programs: Proofreading, stylistic check , 
checks for split infinitives, spelling and 
punctuation errors, overly long sentences, 
passives, word phrases; readability. 

Readability 

1. Readability Analysis 
Apple 

Runs readability tests: Spache, Dale- 
Chall, Fry, Raygor, Flesch, Gunning-Fog 

2. Readability 
Apple 

Spache, Dale-Chall, Fry Raygor, Flesch, 
Gunning-Fog, Smog 
Can make on-screen changes through 
editor function 

3. CRES (Computer Readability Editing 
System) 

Developed by US Navy to a xess techni- 
cal and instructional material. Flags 
uncommon words, misspellings, iong 
sentences, passive sentences, 'to be 7 
constructions and gives readability score. 
Specialized word lists. 

Drill and practice 

eg Text Critique, RSVP, Cameiot, Writer/ 
Grader/Reader; Report 

Reference Notes 

1. The term was coined by the well-known 
American writing educator, Ken Mac- 
rorie. 



2. Researchers are using computers to 
record every keystroke that students 
make as they write. The resulting infor- 
mation is then linked with a new type of 
retrospective protocol analysis, in 
which students describe their writing 
choices as they watch their changing 
drafts on video. Details of this research 
is found in Hawisher, 1986. 
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Considering the large numbers of university 
computing studen ts and the scarcity of teaching 
staff, too many tutor-hours are tied up manually 
marking student programming assignments. 
The possibility exists for much of the assessment 
to be automated since the student programs are 
already in a computer readable form. Many 
departments teaching computing do have some 
on-line systems whereby student programs are 
collected and some checking done. However in 
most cases the tutor is at least required to check 
the source code far such aspects as structure, 
readability end adherence to specifications. 
This paper discusses the requirements for an 
automated system that carries out much of the 
tutor's task. It describes the performance of such 
a system used foi a course which teaches FOR- 
TRAN to second year Diploma students at this 
unive^lty. 



The teaching of computer programmming 
at tertiary level continues to involve large 
numbers of staff and students in a variety of 
departments. The assessment of student 
programs is frequently carried out manu- 
ally by tutorial staff. This process tends to 
be unreliable due to its subjectivity and 
well as occupying tutor time that could 
better be spent elsewhere. This paper dis- 
cusses a system which has automated this 
process for a course which teaches FOR- 
TRAN to second year Diploma students at 
this university. 

With computer assessment of non-com- 
puting subjects there is often a problem of 
combining the expertise in the subject 
matter with the ability to write the required 
computer package. With a computer pro- 
gramming subject this should present no 
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problems as the teaching staff should be 
able to design and write an assessment 
package themselves. Another bonus for 
this type of system is that the students' 
work is already on the system in a com- 
puter file. 

Indeed many departments teaching com- 
puter programming do have some on-line 
system thereby student programs are col- 
lected and some checking done, for ex- 
ample Bailes 1983, Whale 1983, Hext & 
Winings 1969. However this is usually 
limited to a run of the program against tesl 
data. In most cases the tutor is still required 
to assess the source code for such aspects as 
structure, readability and adherence to 
specifications. 

The tutor's assessment of a computer pro- 
gram is in some respects akin to the assess- 
ment of an English essay with corre. ond- 
ing complexities. In some aspects it would 
be almost impossible to replace human 
judgement with a computerized process, 
for example in assessing the relevance of 
comments Although this is beyond the 
capabilities of the type of system used here, 
in general the prospect of objectivity and 
consistency, together with the saving of 
valuable tutor time should tip the balance 
in favour " ' n automated system. 

The System Design. 

The first task in designing this system was 
to decide what criteria should be used in 
evaluating the students' work. It was 
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necessary to look at the way tutors were 
currently operating as well as how the as- 
sessment would reflect the overall objec- 
tives of the course. It should be kept in 
mind that the assignments were given to 
the students for both teaching and assess- 
ment purposes. 

For the FORTRAN course involved the 
following categories crnerged as the main 
areas for assessment: 

a. Adherence to standard language syntax 

b. Use of appropriate data structures 

c. Adherence to accepted code structure 
(sequence, selection and iteration) 

d. Appropriate modular programming 

e. Readability and documentation 

f . Adherence to the assignment specifica- 
tions 

g. Validation of the program with t<*?t 
data. 

The next step was to identify what empiri- 
cal measurements could be made in the 
categories listed above. Compiling the 
program would help test category (a) while 
running the program with test data could 
be used for category (g). It was not difficult 
to implement procedures to first of all col- 
lect the students' source code, and then test 
compile, link and run them. 

Categories (b) to (f) would on the other 
hand require some analysis of the the text of 
the source code. For this a substantial 
program was written to examine the stu- 
dent source code, producing both a report 
for the student and a mark which, com- 
bined with a mark for the compilation and 
run, gave an overall grade for the assign- 
ment. An overview of this program now 
follows. 

Overview of source code assessment 
program. 

Without making a full semantic analysis it 
was necessary for the program to recognise 
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FORTRAN statements and some features 
within them. Given the student source 
code, first the modular structure and then 
the code structure wit! n each module is 
identified. Several checu, are then made. 
Indentation and the use of comments are 
used as a measure of readability. Al! vari- 
ables must be declared, suitably assigned 
and used appropriately as arguments to 
subroutines, in common statements or as 
arrays. Counts are made of all types of 
FORTRAN statements use, each type of 
data structure, module etc. 

For each assignment the person supervis- 
ing the marking must decide on numerical 
constraints for the parameters to be used in 
the assessment; for example the number of 
functions and subroutines, the number of 1, 
2 etc dimensional arrays, the number of 
each type of statement and so on. The 
marker enters these numbers as allowable 
ranges which are used in the final phase of 
the system when the mark is generated. 
These ranges should be decided from the 
assignment specifications and a look at a 
few of the students solutions. For example 
an assignment, where a student is asked to 
read names into an array from a file using a 
dummy end of file marker, should have at 
least one while loop, a 1 dimensional array 
and so on. it helped if the assignment 
specifications were designed with the as- 
sessment method in mind. 

The complete system. 

The complete system consists of 5 stages 
each of which is processed in batch fashion. 

The first stage is liie collection process. As 
the students work on stand alone PC's, the 
tutor sets up a floppy disk running a pro- 
gram which copies the students' source 
code onto the tutor's disk. 

The second and third stages involve batch 
compilation and run processes with rec- 
ords kept for each student on the success or 
otherwise at each stage. 
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The fourth stage is a run of the source code 
assessment program discussed above. 

In the final stage, the output files from the 
last three stages are merged to produce a 
report and mark for each student. The 
students are issued with this computer 
generated report which includes a sum- 
mary of their modular and code structure, 
their use of variables, any marks lost for 
bad structure, bad indentation, lack of 
comments, undeclared variables and so on. 
An example of such a report is shown in 
Appendix A. 

Evaluation of the System Performance. 

Duringits development in 1986, the system 
was used to assess 5 programming assign- 
ments given to 30 to 40 students through- 
out the course. The system was evaluated 
in the following three areas: 

a. The students involved were surveyed 
for their opinions of the system. 

b. A comparison was made on one assign- 
ment of manual marking versus the 
computer generated mark. 

c. A comparison was made of one feature 
or the students' cede (indentation) as 
the system was used. 

The results of these evaluations are as fol- 
lows: 

a. The students were asked 3 questions at 
the end of the session in which the sub- 
ject was taught. 

1 . On the preferred method of submitting 
programming assignments 70% of stu- 
dents said they preferred the new sys- 
tem of collecting source code to the old 
method of getting printout of source 
code and sample runs. 

2. On the helpfulness of the computer 
generated report 10% said it was very 
helpful, 90% fairly helpful and 0% said 
it was not very helpful. 
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3. On the preferred method of assessment 
50% said they preferred the computer 
generated assessment, 25% said they 
preferred a manual assessment by the 
tutor and 25% had no preference either 
way. 

b. Assignment 5 was marked both manu- 
ally and by the computerized system. 
The resultant marks out of 10 are listed 
in Appendix B. 

A comparison of the two sets of marks 
show the following: 

Average manual mark = 7.75 
Average computer mark = 7.95 
Average difference (between marks for 

each student) = 05 (6.5% of marks) 
75% of each student's marks were within 

0.5 

90% were within 1.0 

Theo ly significant discrepancy in the two 
marks for any given student was for the 
very weak students and to a lesser extent 
for the best 2 or 3 students. For the weaker 
students the computer generated mark was 
consistently more generous whereas for 
the top students it was slightly lower. For 
the main bulk of students, the agreement 
between the two marks was within the 1 
mark resolution of the marking scheme. It 
may be significant that the automatic mark- 
ing scheme tends to be somewhat more 
conservative than the human marker. 

c. A comparison was made on the occur- 
rence of indentation errors in some of 
the latter assignments compared to the 
first, before which the students had had 
no feedback from the system. In the first 
assignment the students' programs had 
4.7% of total lines of code with bad 
indentation. This dropped down to 
1.5% for assignment 3, the largest of 
their assignments, and remained under 
2.0% for the remaining assignments. 
While there is no comparison with 
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comparable improvement that may 
have occurred had students' work been 
marked manually, it seems likely that 
students tend to take more notice of 
computer generated diagnostics than 
they do of the tutor's red pen. 

Conclusion. 

On the whole the experience with the sys- 
tem in its first year of operation appeared to 
be beneficial both for the tutor and the 
students and it was successfully used for 
the same course again this year (1987). 

The system was developed specifically for 
a course of second year students studying 
FORTRAN. The number of students was 
therefore not large and the students were 
reasonably competent. The advantages of 
the system in saving of tutors' time and 
uniformity of assessment would be most 
valuable in courses involving large num- 
bers of students and rrcny tutors. A system 
is at present being developed for a first year 
COBOL course involving 350 students and 
12 tutors. 

Both the FORT AN and COBOL courses are 
undertaken mainly by commerce students 
and so the design of the courses and hence 
the assessment criteria are in accord with 
this. It is doubtful therefore whether the 
systems would translate directly into 
courses in other departments, say for ex- 
ample Computing Science. However the 
general principle and design could readily 
be applied to a wide variety of courses and 
from the experienced already gained I 
would suggest that it is an option well 
worth considering. 

Bibliography 

Bailes, C.S. (1983) A Tutorial Introduction to 
the Submit System, Wollongong: De- 
partment of Computing Science. Wol- 
longong University. 

Clarke, R.M. et al (1980). Undergraduate 



Performance in an Innovative Medical 
Curriculum Indicators of Performance. 
SRHE Pwceedings. 
Hasan,H.M.(1986) Automatic Assessment 
of Student Programming Assignments 
for the Course AIC A 201 User and Sys- 
tem Documentation. Wollongong Uni- 
versity. 

Hall, H.M. and Kidman, B.P. (1975). Em- 
pirical Analysis of BASIC and FOR- 
TRAN Programs. In O. Lecarme and R 
Lewis (Mds).Computers in Education.. 

Hext, J.B. and Winings, J.W. (1969). An 
Automatic Grading Scheme for Simple 
Programming Exercises, CACM, 12(5). 

Hille, R.R and Higginbottom, T.F., (1983). 
A System for Visible Execution of Pas- 
cal Programs", Australian Computer 
Journal ,15(2). 

Microsoft (1984). MS-FORTRAN User 
Guide and Reference Manual. 

Sperry (1984). Guide to DOS 2.22. 

Su,Y.W. and Emam,A.E. (1975). Teaching 
Software Systems on a Microcomputer 
A CAI Approach. In O. Lecarme and R. 
Lewis (Mds).Computers in Education.. 

Whale, G. (1983), The Give Report, Kensing- 
ton: School of Electrical Engineering 
and Computer Science, UNSW. 

Whitlock, L.R. (1976). Interactive Test Con- 
struction and Administration in the Gn- 
erative Exam System. Doctoral Thesis 
University of Illinois. 

Appendix A; Sample Report to 
Students. 

AICA 201 PROGRAMMING EXERCISE 4 

Student number 11 - GILLON 

Compilation in 57.01 sees with 0 

error (s) . 

Run in 30.48 sec. 

» module ASS 4 

++ module header 

++ 3D variable used. 

structure : 

READ - CALL SUB - CALL SUB - 
variables used: 
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RESULTS (4, 4, 2) : type: integer, 
IX: type: integer, 
»> module GAME 
structure: 

DO- DO- IF - DO - ENDDO - 
ENDDO - ENDDO - 
variables used: 
IX: type: integer, argument. 
RESULTS (4, 4, 2) : type: integer, argu- 
ment* 

T- type: integer, 
J: type: integer, 
K: type: integer, 
»> module RAND 

— value not assigned to function. 

structure: 

variables used: 

IX: type: integer, argument. 

»> module TALLY 

structure: 

DO - ENDDO - DO - DO - IF - IF - 
ENDDO - ENDDO - DO - ENDDO - DO - 
IF - ENDDO - 
variables used: 

RESULTS (4, 4, 2) : type: integer, argu- 
ment. 

TEAM(4) : type: integer, 

A(4): type: integer, value assigned, 

X: type: integer, 

2: type: integer, 

I: type: integer, 

J: type: integer, 

K: type: integer, 

TOP: type: integer, value assigned, 
NUM: type: integer, not declared 
You have 0 indentation error (s) . 
Counts: READ 1, WRITE 8, DO 8, IF 4, 
WHILE 0 OPEN 2 CALL 2, COMMON 0 
Lines of code: 76, comments 32 
Modular structure: 
program: ASS4 -Subroutine : 

GAME 

->sub^outine TALLY 
->real funv.-±on: RAND 
*MARKS: 

Design: 2.00 Program: 4.50 Re- 
sults: 3.00 TOTAL: 9.5 

Appendix B: Comparison of 
Manual and Computer 
Generated Marks for 
Assignment 5 

o 
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My current position is as a Lecturer in 
the Information Systems section of the 
above school as part of the Faculty of 
Commerce. My background however 
is in Physics with a BSc and MSc. I 
recently completed a post-graduate 
diploma in Computing Science. My 
teaching interests at present are 
mainly in computer programming 
and my personal research interests 
evolve around the better use of com- 
puters in assessment of student com- 
puter programs. I am also part of a 
research group concerned with the 
effective use of computer technology 
to applied computer systems training 
at the tertiary level. 
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Easing the load of laboratory assessment 

Phill Higgins 
Applied Science 

Gippsland Institute of Advanced Education 



At the Gippsland Institute of Advanced Educa- 
tion (GIAE) the drudgery of repetitive marking 
of laboratory reports has been eased by the intro- 
duction of computer assessed laboratory activ- 
ity. This has been achieved by restructuring the 
laboratory activity and literature to be compat- 
ible with the mainframe computer. The entire 
student activity is monitored, assessed and re- 
corded without the lecturer/ demonstrator 
handling one sheet of paper. 



The lectures are fairly straight forward — 
Do some reading, precis a bit here and 
there, copy a couple of diagrams onto 
OHFS, check last years notes, work 
through the examples to make sure they 
give realistic answers, check how you fin- 
ished the last lecture and how and where 
you want to start the next and that is a 
couple of hours work for a one hour lec- 
ture- 
Next, the laboratory work — Students al- 
ready have a set of lab. notesin a booklet, so 
just a final check on the equipment and a 
few notes on instructions and announce- 
ments and that's it — 15 minutes — easy!! 

Now, mark the labs! Thaf s 120 lab. reports 
at 5 minutes or so each — 600 or more long, 
dreary, mind-sapping minutes! 10 hours of 
largely unproductive work! Why can't we 
afford a tutor/ demonstrator/ external 
marker? Anything to ease this slogging 
part of the job is worth a try!. 

Well here's one attempt: Divide the labora- 
tory instructions into three sections (Pre- 
laboratory, Activity, Postlaboratory) and 



call the computer into action.. Each student 
gets a lab. I.D. password and finds a termi- 
nal to the mainframe or a PC somewhere.. 

After a successful log-on and menu selec- 
tion for the required experiment he/she 
sees confirmation that the session is valid 
and then: 

This is the prelaboratory section of 
Lab.X. 

You should already have worked the 
practice problems on litis topic in 
your laboratory booklet and checked 
with your lecturer if you had any dif- 
ficulty. 

You will now be given three ques- 
tions each of which you must work 
through and input an answer to be- 
fore the next is provided. 

They are chosen at random from a 
large list so your friends answers are 
almost certain to be useless.. 
If you fail this exercise you will be 
allowed only one more attempt — 
but NOT WITHIN 30 minutes of the 
failed one. If you fail the second at- 
tempt you will be directed to see your 
lecturer. 

You will NOT be allowed to proceed 
with laboratory activity until you: (a) 
pass the prelab exercise OR (b) have 
r; *rmission from the lecturer. 

Press "enter" to display the first 
question.. 
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The three (say) questions are each chosen 
to illustrate a different concept involved in 
the exercise. For each question there are 
several alternative problems illustrating 
the same concept and it is one of these 
problems that is selected at random. 

Example Question 1 . (not a typical Physics 
problem) 

How many dwarves did Snow White 
keep house to? 

(Enter your answer at the cursor posi- 
tion and press <enter> for your next 
question - no comments will be given on 
your answer. You may discuss your 
answers with your lecturer if you wish). 

Provision is made here for confirmation 
that the intended answer has been correctly 
entered and an opportunity to reread the 
question is also given. 

In this form of numerical answer, written 
responses are returned with a directive to 
input a numeric answer. If a calculation is 
involved from the data given the algorithm 
for this is used by the computer to check the 
student response. 

Example Question 2. 

How many thieves do you associate 
with Ali Baba? 

a. None. 

b. One. 

c. Forty. 

d. One Hundred and one. 

e. Forty thousand. 

Choose the answer you think most cor- 
rect, input its code letter at the cursor 
position and press "enter'' for the next 
question - no comment will be ....etc. 

In this multiple choice type question only 
upper case and lower case of the answer are 
accepted. All other forms Eg fully typed 



answers are redirected and the representa- 
tion of the problem is an option. 

Example Question 3. 

What did Rumplestiltskin offer the 
captive Queen as a means >f free- 
dom? 

Type your complete answer in less 
than 10 words at the cursor position 
and press "enter" for your next etc. 

The correct answer "Three guesses at his 
name" contains 3 key words that must be 
present. The computer searches for these 
and redirects numeric answers Spelling 
errors are allowed for Eg. gueses, 
gesses..etc and a list of synonyms for each 
keyword is provided. 

After the last of the questions has been 
attempted the computer assesses the stu- 
dents performance and directs him/rer to 
proceed with the lab. activity, try the pre- 
lab.. again later on or go to the lecturer for 
review of the prelab... questions. The usual 
pass level is set at about 70% and this seems 
to work quite satisfactorily. Successful and 
unsuccessful attempts are recorded as well 
as the date on which they were made. 

Assessing the lab. activity is the most diffi- 
cult part as numbers and units with toler- 
ances and variations have to be pro- 
grammed for. We have identified each 
piece of apparatus and ask the student to 
identify which piece he used via the cede 
number on it. Results with this equipment 
are checked against results obtained by the 
lecturers using that equipment and accept- 
able ranges are provided. 

It has proven beneficial to "modify" some 
pieces of apparatus so that the result of the 
laboratory activity is easier to handle. Eg 
Fp. experiments on the photoelectric effect 
the bandpass of the various filters used has 
been "fudged" so that a predictable 



ERIC 



321 



312 



Using Computers Intelligently 



straight line results. The gradient of this is 
tested against the "true" values and units 
are checked. 

At present the program does not do a 
straight line fit to the students input points 
but just checks the gradient and intercepts 
he/ she inputs with the acceptable refer- 
ence range. 

Further calculations which have been 
made from gradients, intercepts and other 
parameters etc determined by the student 
are checked using the appropriate algo- 
rithm and data input by the student so that 
an initial mistake is not multiply penalized. 

The post laboratory work is a single at- 
tempt system with usually 2 or 3 questions 
provided for the student to solve. Again 
these are chosen from a file of similar ques- 
tions designed to test the understanding of 
the work that has been done in the lab. 

The final output to the student is his com- 
puter assessment overall. A detailed as- 
sessments provided for the lecturer show- 
ing aii stages or the process.. 

Security is provided at a number of levels: 

a. Student and account ID. This enables 
students to avoid others "practising" at 
their expense. 

b. Code word for viewing of assessment 
lists - each viewing of the assessment 
list is also dated. 

c. Code word for modification to assess- 
ment list outside a student session. 

d. CPU connect times are logged against 
password and ID - this attempts to iden- 
tify the "hackers" trying to crack the 
system... 

The method has various degrees of applica- 
bility to different laboratory activities but 
the prelab and lab. sections can be made to 



apply to almost anything and of course 
there is no testing or feedback on report 
writing skills. However these disadvan- 
tages are more than offset by the huge 
saving in time that is achieved and the 
feedback on report writing is given on the 
laboratory experiments which are not 
computer graded. 



Phill Higgins has been involved in 
Tertiary Education for almost 20 years 
and has lectured in most areas of Phys- 
ics, some of Chemistry and Applied 
Mechanics and a few of Mathematics 
and Biology. His main teaching and 
research interests are in XRay analysis, 
Optics and Huid Mechanics. He has 
been an active member on the Commit- 
tee of the Gippsland Branch of the 
Australian Institute of Energy for sev- 
eral years and has recently become 
involved in Nurse Education from 
which his main incentive for CAL has 
developed. He is a lecturer in Applied 
Science at the GIAE 
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Athena, Andrew and Stanford — a look at im- 
plementation and evaluation in three large projects 

Geoff Isaacs 

Tertiary Education Institute 
University of Queensland 



Massachusetts Institute of Technology and 
Carnegie Mellon University have both em- 
barked on enormous projects designed to im- 
plement workstation environments for use in 
academic endeavours. Project Athena at MIT is 
a network designed to service teaching and 
learning only, while the Andrew network at 
CMU is to service both teaching and research. 
Stanford University's computer-intensive envi- 
ronment for teaching and learning owes no 
allegiance to either the Athena or the Andrew 
model. Here we summarise the environments 
at these three universities and place them in 
context 

It is intended that this paper be the background 
to a presentation at CALTTE 87, which will take 
place after the author has visited these three 
establishments in late September 1987. The 
emphasis of the presentation probably will be 
on the evaluation and staff development activi- 
ties which are being carried out in these three 
universities in support of their CAL systems. 

When one looks at the implementation of 
computer assisted learning in Australian 
universities - or even, by and large, in any 
one university - one generally finds a 
hodgepodge of efforts of varying general- 
ity, sophistication, successfulness and lon- 
gevity. The methods and tools used are 
often totally idiosyncratic even between 
staff members within the same department 
and suppurt from a central authority 
within a university is the exception, not the 
rule. A similar tale can be told of the evalu- 
ation of CAL materials and CAL-oriented 
courses. 

There are overseas - especially in the 
United States of America - numerous large, 
well funded, centrally supported com- 



puter assisted learning projects within 
universities and it seemed to me that there 
might be some profit in looking at how 
some of them attack the problems of the 
implementation, support and, especially, 
the evaluation of CAL developments. I 
therefore decided to devote part of my 
Special Studies Program in the second half 
of 1987 to exploring these very issues in the 
USA. At the time of writing that explora- 
tion lies in the future; however I have now 
accumulated a considerable amount of in- 
formation about the places I will be visiting 
and that information will be summarised 
here by way of background to the paper 
presenting orally at CALITE 87. 

The universities on which I will concen- 
trate are Massachusetts Institute of Tech- 
nology in Boston, Carnegie Mellon Univer- 
sity in Pittsburgh and Stanford University 
near San Francisco. 

Why these universities? MIT and CMU are 
both hosts to multi-million dollar, substan- 
tially externally funded projects each in- 
volving the development of a campus- 
wide network system designed principally 
to support teaching and students. MIT is 
host to Project Athena and CMU is host to 
Project Andrew. Both projects are heavily 
subsidised by computer manufacturers 
who seem to see the universities as cheap 
reseai Ji and development labour and as 
possible test beds for new workstations 
and network developments. The projects 
are, to a limited extent, in competition, and 
both are currently making available to 
educational institutions either free or at a 
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nominal charge software developed in 
their networking projects. Stanford, on the 
other hand, represents the non-aligned, but 
nonetheless computer-intensive universi- 
ties. It is heavily involved in CAL develop- 
ments and has a large central support sys- 
tem for CAL developments, but it has 
elected not to implement a network such as 
the Athena network or Andrew (yet?). 

Carnegie Mellon University. 

Even CMU's own documents speak of 
"Carnegie-Mellon's much ballyhooed ef- 
fort to computerize itself as no institution 
has ever done" (Maguire,1986). The pat- 
tern at CMU has been to install a campus- 
wide computer network (called Andrew) 
linking many advanced computer work- 
stations and high end personal computers 
into one coherent whole. The network and 
its workstations will distribute the load of 
educational computing, it is hoped, thus 
lessening the load on the university's large 
time- sharing mainframe computers and 
providing a more responsive computing 
environment for use in the education of 
students and for research and scholarly 
activity. 

The CMU plan was first formulated in 1982 
and involved the use of advanced function 
workstations having very high resolution 
graphics screens and the storage capacity 
and computing power to enable the graph- 
ics facilities (among other things) to be used 
effectively. These workstations, which 
might be made by any vendor able to meet 
the necessary specifications, were to be 
networked by a system having cabling to 
every room on campus. Eventually there 
was to be a workstation for every student 
(note, however, that contrary to wide- 
spread belief, students at CMU generally 
have not been compelled to purchase a 
computer), faculty member and member of 
the administration on campus - a total of 
some 7000 workstations- It was felt that the 
falling cost of workstations would make 
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this plan feasible by the end of 1986, but in 
the event, the fall has not been as sharp or as 
great as expected. 

IBM, in late 1982, got the project off the 
ground by contracting to spend $US 35 
million to create CMU's Information Tech- 
nology Center (ITC). ITC's purpose is to 
develop the software needed to make fea- 
sible CMU's plans for integrating comput- 
ing into its educational activities. 

It is hoped that the large concentration of 
computing resources becoming available 
to staff and students at CMT J will stimulate 
the growth of a widely u jeful library of 
educational software. To help staff in writ- 
ing such software (by funding, by advising 
or by actually getting it written) is the role 
of the university's Center for the Develop- 
ment of Educational Computing 
(CDEC).— Andrew 

The name Andrew is sometimes used to 
describe all parts of the educational com- 
puting developments at CMU, but most 
frequently Andrew refers to the software 
base on which the developments at CMU 
are built; the best technical description of 
this system will be found in the paper by 
Morris and others (Morris et al, 1986). The 
Andrew software environment consists of 
three components: a high speed (4 to 10 
Mbitsper second) network, a file system to 
support a very large number (thousands) 
of workstations on that network and "a 
friendly, graphics- oriented operating 
framework for users of workstations'' 
(Sherwood,1986) - that is, a user interface 
for graphics workstations. 

The operating system on the computers 
which form the backbone of the network is 
called VICE ("Vast, Integrated Communi- 
cations Environment"). VICE emulates a 
time-sh?ring file system; that is, there is one 
single file system for all stations on the 
network. It is integrated to such an extent 
that users may "access files in a uniform 
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manner regardless of the specific worksta- 
tions at which they are logged in, or where 
the files were created originally v (Morris et 
al, 1986). Changes to files are recorded 
centrally by VICE every few seconds re- 
gardless of where those files have been 
used. Devices like printers/ bulletin boards 
and electronic mail systems are built on top 
of VICE and/ like the file system, are avail- 
able quite transparently to workstations 
users who need not know their physical or 
machine locations. Files in VICE being ac- 
tually used by a user are in almost all cases 
copied to a cache on the workstation at 
which the user is currently working. 
Changes to these files are made on the copy 
in the cache and the file is written back to 
the common VICE storage area when it is 
closed. 

The VICE file system is considered to be 
extremely secure because no user pro- 
grams run on the computers which hold 
and control the VICE file system and file 
traffic carries only complete files from 
workstation to file server. In an ordinary 
network there would be an enormous 
amount of paging of file fragments be- 
tween workstations and servers; however 
it was judged that the teaching and aca- 
demic environments could generally be 
adequately serviced by a filing system 
model rather than the usual networked 
database model which allowed continuous 
access to the database for update and 
modification by several users. Where such 
databases are needed by Andrew users 
they are supplied on an ad hoc basis by 
access to the university's pre-existing 
mainframe and mini computers. 

Arms (1987) reports that in January 1987 
there were 17 servers on VICE. Two of 
those servers were IBM PC-kTs and the 
remaining fifteen were Sun 2's and Sun 3's. 
Their total storage capacity was 17 Gigaby- 
tes. At the same time there were 3400 regis- 
tered users with about 450 Unix worksta- 
tions connected to the VICE system. This is 
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only about half of the eventual target 
number of users. 

Workstations under And* ew must satisfy a 
few conditions before being usable in the 
system. They must be fairly powerful (at 
least 1 mips), need a high resolution graph- 
ics screen (in the region of one million pix- 
els), need substantial random access mem- 
ory (in excess of one megabyte - preferably 
three or four), local mass storage (either a 
substantial fixed disk in the region of 40 to 
100 megabytes or very fast access to a lo- 
cally networked disk which emulates a 
local one), an Ethernet or a Token Ring 
interface; and they must be able to run the 
BSD 4.2 version of the Unix operating sys- 
tem (this last need au t omatically implies all 
of the others except the graphics screen and 
the network interface). Andrew as cur- 
rently implemented does not allow the 
current generation of personal computers 
(IBM PC and AT, Apple Macintosh/ Mac 
Plus and Mac SE) to be connected. A new 
version - Andrew Plus - will also allow 
limited use of conventional personal com- 
puters. Currently four types of Unix work- 
station are supported; they the Sun 2, Sun 3, 
IBM RT and Vaxstation II (see Arms, 1987). 
Andrew has been designed so that it is 
relatively easy to add support for other 
makes of workstation which satisfy the 
prerequisites set out above. Support for 
conventional personal computers, when 
completed, will allow them to treat the 
Andrew filing system as if it were a huge 
hard disk attached to the personal com- 
puter; an intermediate server (a Unix 
workstation) will sit between the personal 
computer and VICE and will hold the local 
copy of the VICE file being used by the 
personal computer. In early 1987 the IBM 
PC Server was complete and operational 
while the Apple Macintosh Server was 
expected to be available before the end of 
the year (see Arms, 1987). 

The user interface environment running 
under 4.2 BSD Unix on the workstations is 
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called VIRTUE ("Virtue Is Reached 
Through Unix and Emacs"). VIRTUE con- 
sists of a toolbox ("an object-oriented 
multi-media environment for applications 
development", to quote Arms, 1987) which 
handles the interface to the VICE file sys- 
tem and has a window manager that allows 
multiple processes to share the high resolu- 
tion bit mapped display, and packages for 
manipulation of text and graphics. Cur- 
rently Andrew uses its own, home grown 
window manager, however it is planned 
shortly to re-implement the Andrew user 
interface as layers on top of the more 
widely supported X Windows system 
developed at MIT. This is the first clear 
indication of what seems to be a conver- 
gence among some of the large university 
CAL projects, although communication 
between them has always been consider- 
able. 

Computer assisted learning at CMU 

Naturally computer assisted learning long 
predates Andrew at CMU. The CMU cata- 
logue of educational computing projects 
(Seiden, 1 986) lists in excess of one hundred 
projects, some datingback to the 1970% but 
most from 1984 on ward. The target systems 
for these projects are as follows: IBM Per- 
sonal Computer (some for PC, some for AT, 
various display adapters) - 39; Andrew - 33; 
Apple Macintosh (various models) - 4; 
other (mainly HP9836's running Unix in 
engineering departments) - 34; total - 110. 
Where a project was originally developed 
on another system, but has now been 
ported to Andrew it has been counted only 
under Andrew. These projects range from 
small BASIC language programs plotting 
graphs on a personal computer to large 
scale CAL authoring systems using all the 
facilities of Andrew, such as CMU Tutor. 
The bulk of the projects are in engineering, 
mathematics and science areas, but there is 
a significant number in the social sciences 
and humanities. 



CMU Tutor 

It is perfectly possible to use the facilities of 
Unix and Andrew t o develop custom made 
computer assisted learning materials. The 
Andrew window manager has functions to 
allow user programs to handle text and 
graphics within windows and there are 
other, higher level programs to make this 
process simpler (the Grits database facili- 
ties, a graphics layout organizer and the 
like). However many potential clients of 
Andrew have neither the patience, nor the 
skills, nor the time to acquire them in order 
to use the C language and these tools to 
program their CAL applications under 
Andrew/Unix. CMU Tutor has been de- 
veloped by Bruce Sherwood, Associate 
Director of CDEC and Judith Sherwood of 
the Mellon College of Science, together 
with other staff of CDEC and ITC in order 
to address these problems (Sherwood, 
1985; Sherwood and Sherwood, 1985; Sher- 
wood and Sherwood, 1986). 

CMU Tutor is described by its implemen- 
tors as "an integrated programming envi- 
ronment for advanced workstations'', but 
it has now also been implemented on 
Apple Macintosh and IBM Personal Com- 
puters, although not all programs created 
on advanced workstations can be moved to 
these personal computers (the reverse does 
seem to be the case, however). It is an 
adaptation of the PLATO project's Micro- 
Tutor language (Sherwood and Sherwood, 
1985) with extensions to support win- 
dows, mice, menus and other Andrew/ 
workstation features. It is an incrementally 
compiled language (so lessons can be 
tested very soon after they have been writ- 
ten or revised) which supports all of the 
special text forms used by the Andrew 
editor in What-you-see-is-what-you-get 
format (bold, italics, font changes, center- 
ing etc) and includes extensive graphics 
capabilities including a graphics editor. 
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Massachusetts Institute of Technol- 
ogy 

MIT's big thrust into campus-wide com- 
puter assisted learning started almost con- 
temporaneously with Carnegie Mellon's. 
The MIT plan, announced in May 1983 was 
a five year plan "to explore ne w, innovative 
uses of computing in the MIT curriculum" 
(Lerman, 1987). MITs plan was realized by 
the creation of Project Athena, a $US 70 
million project financed by IBM and Digital 
Equipment Corporation to the extent of 
$US 50 million and MIT Coy various fund 
raising initiatives) to the extent of $US 20 
million. The support from DEC and IBM is 
support in kind (equipment, software, 
maintenance and staff support etc) not in 
cash. 

like the developers of CMU's Andrew, 
Athena's proponents would like software 
developed in the projects to be runnable on 
advanced function workstations from any 
vendor and have opted for Unix as the 
operating system of choice for those work- 
stations. 

Project Athena 

What exactly are the goals of Athena? Ler- 
man (1987) writes: 

Project Athena's mandate is to explore 
diverse uses of computing in support of 
education and to build the base of knowl- 
edge needed for a longer term strategic 
decision about how computers fit into the 
MIT curriculum. We encourage a wide 
range of educational applications to 
understand how computing helps stu- 
dents learn; we place computers in di- 
verse settings to explore how different 
physical arrangements affect the use and 
value of computing; we experiment with 
different types of software to learn about 
its utility, reliability, the ease with which 
it can be run in a very large computing 
system and the costs of supporting it. 

ERLC 



About half of MIT's $US 20 million contri- 
bution to Athena is being spent on the 
sponsorship of curriculum development 
projects. A project may be supported by 
direct funding, the supply of computa- 
tional resources, the supply of program- 
ming assistance, the paid release of faculty 
from teaching or other duties. One 
hundred and eleven projects had been 
funded as at autumn 1986, almost exactly 
the same number as at CMU in a similar 
period. Funded projects need not be on a 
large scale - even small projects from indi- 
vidual staff members can be accepted. 

Note that there is a major difference in 
philosophy between Athena and Andrew. 
The Andrew project is aimed at producing 
an efficient networked workstation envi- 
ronment which will facilitate the use of 
computers in education. It was felt that the 
provision of such an environment would 
provide the critical mass of support and 
resources needed to generate a significant 
growth in such usage. The Athena project is 
taking exactly the opposite approach. They 
are fundingand encouraging an increase in 
the amount of educational computing ac- 
tivity in the hope that, at the end of the 
project's five year life they will be better 
able to design or select an appropriate 
environment for educational computing. 
Another major difference is that the An- 
drew project is aimed at the support of all 
persons on campus - students, academics, 
administrators - in the course of their work, 
while MITs Athena is aimed mainly at the 
teaching of undergraduate students and, to 
a much lesser extent, at the teaching of 
postgraduates; it is absolutely not aimed at 
supporting staff in their research and schol- 
arly activities. 

Athena's catalogue of projects (Stewart, 
1986) lists 60 in all.Of these projects twenty- 
five are described as being implemented on 
Athena Workstations (Vaxstation II or IBM 
PC-RTs mainly), eleven are implemented 
IBM PC-ATs, mostly in the "Athena con- 
figuration" (which includes an IBM Profes- 
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sional Graphics Adapter), six are on IBM 
PCs, and eighteen on other systems (gen- 
erally, where it is clear what other system 
then it is one of MIT's large time sharing 
systems). Where a project has been imple- 
mented on both a PC and an Athena Work- 
station it has been classified only in the 
latter category. 

This split of system types reflects accu- 
rately the development of Athena and its 
own philosophy. Since the aim was to 
develop a critical mass of computer as- 
sisted learning activity on campus, 
Athena's directors did not wait for the ideal 
workstation environment before sponsor- 
ing projects. Rather, they elected where 
possible, to move with an intermediate 
system - a heavily optioned IBM PC-AT - 
and, where even that was not possible, 
opted to use whatever usable system was 
available. Thus some of the projects in the 
1986 catalogue are conversion projects, 
moving projects from Athena ATs or large 
time sharing machines onto Athena work- 
stations. This generally seems to involve 
mainly conversion of the windowing and 
graphics facilities to Athena's standard. 

Evaluation and Athena 

There seems to be more evaluative activity 
of the educational aspects of Project Athena 
that there is at Andrew. This is, in part, a 
further consequence of the differing devel- 
opment plans for the two projects. 
Athena' s emphasis on C AL software rather 
than network software means that there is 
likely to be more to be evaluated. Yet the 
difference is greater than that. Athena has 
actually created an Project Athena Study 
Group which looks at the effects of Athena 
on MIT. To date, however, the Group has 
published no papers or reports available to 
outside scholars. The Project also sponsors 
directly a longitudinal survey of under- 
graduates since 1985 in order to look at 
patterns of student use of computers. The 
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most recent of these (Cohen, 1986) details 
the results of the 1985 and 1986 surveys. 
Cohen's report shows that a very high - and 
increasingly so - proportion of the under- 
graduate student body has used Athena (87 
percent), such use amounting to over three 
hours per student per week on average. 
Interestingly, she found that usage by male 
and female students was equal in all classes 
and years at MIT, "...in contrast to male- 
dominated and senior dominated uses of 
other computers at M.I.T/'. At present stu- 
dents' usage of Athena is much more likely 
to be personal (word processing and the 
like) than required for courses. Needless to 
say, most of the personal usage is course- 
related, however. Athena has entrenched 
itself in students' consciousness to such an 
extent that, according to Cohen, they "re- 
gard Athena as a service rather than as an 
experiment". This means, of course, that 
they criticise it as a service rather than as an 
experimental setup and this seems to be 
reflected in their complaints about 
crowded or inaccessible facilities, slow 
systems and system unreliability as well as 
low quality printers. It would seem that at 
this stage Athena's massive injection of 
funds and equipment has not solved the 
usual central computer service blues en- 
countered by so many tertiary education 
institutions. To be fair, the Athena to which 
students are reacting at this stage is largely 
one of terminals to a time sharing system; 
it does not yet include the sophisticated 
workstations which presumably will 
lessen at least some of the problems re- 
ported above. 

In addition to the large scale evaluations 
mentioned above there is also a significant 
amount of localised evaluation of materials 
and courses within individual projects 
sponsored by Athena. Some of this activity 
is mentioned in Ste^varf s (1986) compen- 
dium of projects, however few results of 
these evaluations have yet reached the 
open literature. 



Using Computers Intelligently 

Stanford University 

Stanford is not at the centre of a large exter- 
nally funded project like those at CMU and 
MIT, but it is, nonetheless, a highly com- 
puter- intensive educational environment. 
However, possibly because it has no "big 
name" project, it is less well covered in the 
litenture. All of the information presented 
here comes from an article in the February 
1987 issue of Byte magazine (Osgood, 
1987). 

The centre of activity at Stanford seems to 
be IRIS -Instruction and Research Informa- 
tion Systems - and its attitude, a^ reported 
by its director, Michael Carter, seems more 
akin to the Athena philosophy than the 
Andrew philosophy: 

\ K7 hai we are trying to do is enhance aca- 
demic achievement by applying computer 
technology- Our best bet is to try to focus it 
a little here, nudge it a little there, lead a 
little bit over here. With so many really 
smart faculty members out there, I want to 
get them enough devices so that they know 
exactly what they want to do, and then 
follow them, rather than to control the way 
they use computers. The trick really is to 
remove the obstacles so that those people 
can lead the way, 

Stanford has several "public" clusters of 
computers for student use (with students 
who are required to use them in their 
courses getting priority in access. Such 
clusters provide either personal computers 
only or a mix of personal computers and 
terminals connected to Stanford's time 
sharing system. There is also a number of 
classrooms at Stanford with PCs built in, 
some including large screens so that a 
whole class can view the same screen im- 
age. One gets the impression that at .Stan- 
ford App*e Macintosh computers are pre- 
ferred over IBM personal computers or 
compatibles. 
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IRIS supports CAL developments in sev- 
eral tangible ways. Among these is the 
Faculty Author Development program, 
under which IRIS has helped faculty to 
complete 36 software development proj- 
ects ranging widely over the university. 
Such help may come in the form of varying 
combinations of equipment, design or 
programming support. Beyond such direct 
to aspiring CAL teachers, Carter's unit is 
trying to develop a range of self h Ip tools 
to decrease dependence on IRIS for the 
preparation of CAL materials per se by 
making it easier for staff to write their own 
programs. The CAT (Courseware Author- 
ing Tools) project, as this latter develop- 
ment is called, is being implemented on 
workstations similar to those being tar- 
geted by Athena and Andrew. Indeed, it is 
not the aim of IRIS necessarily to develop 
the required tools in house; they are quite 
prepared to borrow software from other 
projects, naturally including Andrew and 
Athena. 

Conclusion 

The real conclusions to this paper do not yet 
exist; they will be given in the oral presen- 
tation to which this written work is the 
background. It is hoped that the presenta- 
tion will concern staff development and 
evaluation at the three sites named above, 
however, on the basis of our preliminary 
reading, we are not optimistic that the:? 
will be a great deal to report either from 
Stanford or from CMU. However appear- 
ances from the other side of the world can 
be very deceptive, so my forthcoming visit 
may produce some surprises in these areas. 

All the above having been said, we can 
reach one significant conclusion on the 
basis of the earlier sections of this paper, 
and that is that there is a clear convergence 
among al! three of these sites in the soft- 
ware and the hardware they are using. In 
hardware all three seem to be moving away 
fr^m conventional personal computers 




320 



Using Computers Intelligently 



and towards advanced networked work- 
stations with very high resolution graphics 
and network connections. This reflects in 
part the increasing complexity of the tasks 
such workstations are being asked to carry 
out - in many cases supporting a multi- 
purpose working and learning environ- 
ment, not just running a few computer 
assisted drill and practice sessions - and in 
part the increasingly detailed graphics 
being required for tasks from those previ- 
ously mentioned to supporting a 
"friendly" operating environment for the 
computer illit .ate. The great unknown in 
this choice of equipment is Apple's Macin- 
tosh II, which seems to be the only personal 
computer available in the marketplace at 
present (and it is only just available) ca- 
pableof challenging the workstations on all 
counts; its future role at these sites may be 
clearer by the time I visit these sites in 
September 1987. 

As far as software is concerned, the conver- 
gence seems partly the inevitable conse- 
quence of several sites independently pur- 
suing the same ultimate aims with substan- 
tially the same set of hardware. B» it it i s also 
the result of a freer sharing of expertise and 
of the actual software itself than might have 
been expected from the earliest publicity 
about Andrew and Athena. This in turn 
results from all of the projects being strictly 
non-proprietary in their target machines 
— Andrew would not be looking to use 
MIT's X Windows environment if it were 
targeted at one machine or owned by one 
manufacturer; it seems to have been 
adopted by Andrew not only because it is 
superior to Andrew's own home grown 
product, but also because it is increasingly 
being supported by equipment manufac- 
turers. As an Australian I can only hope 
that th:se universities will be as generous 
with their CAL lesson software as they are 
at present with their systems software. 
Then my only problem will be to work out 
how t( 'und the purchase of a couple of 
bundiv x 6 advanced function workstations - 



one senses that this is proving a greater 
problem than expected in the USA also. 
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Current computer technology is fast becoming 
an important and widely used instructional tool. 
But managing the education process is much 
more than just instruction or assessment. This 
paper looks at the concept of an integrated 
computer based teaching system. At least three 
component areas of computer use may need to 
be integrated to produce comprehensive, 
student-centred learning systems -compute* 
based instruction, computer managed learning 
and computer assisted course authoring. This 
paper offers an analysis of the advantages of 
integrating these areas to form a computer based 
education "system", rather than leaving them as 
isolated, unconnected 'application' areas. The 
limitations and requirements of such an integra- 
tion process are examined and the ?y feasibil- 
ity of the concept opened for discussion. 

Computer aided techniques now impact on 
a whole variety of tasks in the educational 
process. The penetration is becoming in- 
creasingly pervasive and sophisticated, 
both in design philosophy and task com- 
plexity. But the potential for the integration 
of computer assistance into a 'system' of 
integrated software products covering the 
total educational processunder acomputer 
based technological umbrella remains 
largely unrealised. On the surface the ap- 
proach could combine integration with 
extension — generating and managing 
courses based on sound educational prin- 
ciples in diverse areas. Certainly the techni- 
cal expertise and the necessa. y umbrella of 
technology is there. But attempts to pro- 
duce complete/ computer based education 
systems appear to have lagged behind 
technological capability. The proponents 
of integrated computer based education 
systems (CBES) argue their benefits 
strongly. But to date few comprehensive 



products have appeared, and only limited 
use made of the potential. Why is this? 

This paper examines the potential cf CBES 
as an example of an integrated approach to 
using computers in tertiary courses. Com- 
puters cart also be used in the educational 
environment for various administration 
applications, but this paper concentrates 
only on educational applications. 

The paper is organised as follows. Section 
two briefly examines the philosophy be- 
hind a 'systems' approach to computer 
based education. The section reviews some 
of the major functions and components 
typically attributed to these systems to il- 
lustrate the concepts of integration and 
extension (generality or application) which 
these systems offer. Section three exam- 
ines the advantages and benefits claimed 
for an integrated approach to the educa- 
tional process. Section four outlines limit- 
ing requirements and suggests possible 
shortcomings. Section five advances tenta- 
tive conclusions on the future of the CBTS 
philosophy. The aim is to generate discus- 
sion of these issues based on participants 
individual experiences within tertiary 
education situations, rather than provide 
answers. 

The CBES Philosophy 

Current CBES systems grew out of ex- 
tended computer based systems that are 
designed to manage assessment admini- 
stration and recording keeping within the 
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the learning process (CML) (Rushby, 1985). 
Traditionally/ most CML systems are based 
on a model of student study behaviour, and 
concentrate on managing reporting and 
assessment procedures in an attempt to 
allow the teacher to concentrate on teach- 
ing. They typically provide support in four 
areas: 

• construct, mark and analyse tests for 
diagnostic/assessment purposes; 

• keep student progress/performance 
records; 

• provide individual guidance through 
structured course material; 

• feedback reports on students perform- 
ance and progress to teacher. 

Using extended CMl/s as an interface, the 
CBES concept attempts to integrate course 
authoring, computer aided instruction, 
learning assessment and course manage- 
ment into an integrated suite of software 
packages. Typically three features charac- 
terise these systems: 

1. Thebasicdesignapproachviewscourse 
design and implementation as an edu- 
cational process which consists of se- 
quential tasks that are purposive i.e. 
directed towards particular educa- 
tional objectives. This contrasts with 
previous, segemented approaches di- 
rected at isolated tasks in the education 
process. 

2. The design approach integrates the 
separate computer aided tasks into a 
system design philosophy. The empha- 
sis is not just task compatibility but inte- 
gration into a total system design. 

3. The previous concept of computer 
managed learning is expanded to in- 
clude the whole range of tasks which 
make up the education process in the 
design, construction and delivery of 
courses. Attention focuses on using the 
computer to actively manage the whole 
educational process rather than just 
managing CAI and assessment proce- 
dures. 



The design concept of CBES is based on the 
principle that the process of course design, 
implementation and management is com- 
posed of a series of sequential tasks that can 
be defined and modeled as an educational 
process. The nature of these tasks and the 
use of computer and communications tech- 
nology to assist their accomplishment is 
well documented (see, for instance, CBTS 
1983; Denholm, 1984). Since common tasks 
are involved in all course design and imple- 
mentation, compu ter based systems design 
can be used to manage the learning envi- 
ronment, and to provide the integrated 
environment for developing CAI pro- 
grams where these are evaluated as being 
desirable and necessary. Tne integration of 
CAI, CAS and CML functions under one 
technological umbrella has been desig- 
nated CBTS or CBES. The emphasis is now 
on integrating separate tasks as part of a 
total system. 

Historical Perspective 

The historical impact of computer technol- 
ogy on the tertiary education process is one 
of ever wider and more sophisticated aj> 
plications. The progressive steps in the 
progression include 1 : 

• use of computers as an instructional aid 
as an outgrowth of programmed learn- 
ing (Rushby, 1985); 

• growth of interactive instructional dia- 
logue; 

• using the computer to aid or control 
design of the instructional process, in- 
cluding course authoring; 

• using computers to manage the learn- 
ing process; 

• th 2 development of integrated CBES. 

These steps reflect the development of 
computer aided instruction (CAI), lesson 
and course authoring systems (CAS), com- 
puter managed course implementation 
(CM1) and then using computers to man- 
age the whole learning process (CML). Of 
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course thedefinitionof the tasks performed 
by these categories will vary between place 
and author; especially for instance in the 
scope of computer assisted instruction 
(CAI) [See, for instance, Robbins (1983)]. 

McDevitt and Price (1984)provide an alter- 
native view of this progression. They sug- 
gest that the development path taken by 
computer based teaching systems reflects 
the general evolutionary pattern of infor- 
mation processing technology. This pro- 
gresses from the Transaction Processing 
Phase, through the Information Processing 
Phase, to the Data Management Systems 
phases. 

This proliferation of computer aided task 
performance has several features relevant 
to the present discussion: 

• Evolution of software for computer 
based course authoring and managing 
has been superimposed on the more 
traditional 'passive' role of computer 
aided instruction; 

• A progressive process of bringing to- 
gether technological advances in sev- 
eral areas including information tech- 
nology, communications, and network- 
ing; 

• Improvements in understanding of the 
analytical and design of coursepresen- 
tation, design, learning and the educa- 
tional environment; 

• Increasing analysis of educational ob- 
jectives and their effective attainment 
through computer assistance; 

• Analysis of the education process into 
separable tasks, and breakdown of the 
components of those t^sks; 

• The development of increasingly com- 
plex sets or suites of software that were 
compatible with one another; 

• Often built by those in charge of 
courses, rather than those skilled in the 
theory of education and learning; 

• Much reinventing of the wheel due to 
separate developments of functionally 
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similar software suites in different insti- 
tutions, and even within institutions; 

• Specificity and lack of transferability of 
applications software. Applications of- 
ten limited to specific courses or com- 
puter systems. 

The developing sophistication of many of 
the computer based course authoring aids 
also focused attention on the need for 
computer involvement in the 'active' areas 
of course design and management fol- 
lowed by management of the learning 
process rather than just 'passive' computer 
use in already designed lessons or courses. 
Many of the essential ideas of integration, 
extension, system and educational process 
are present in these developments (Harris, 
1983). For instance Sutanto(1984) gets near 
to the concept in his Computer-Based 
Teaching System in Power System Analy- 
sis. 

The motivations for movement from a 
'passive' role of computer usage for com- 
puter aided instruction towards a more 
'dynamic' involvement in managing the 
teaching process may be complex. But eco- 
nomics is never far away. Tertiary educa- 
tion is notoriously short on funding. The 
expensive nature of CAI soon emphasised 
the need for strategies, since CAI can be a 
costly tool to devise. The following critical 
questions began to be asked: 

• what should be CAI'd 

Q which students should get CAI 

• reducing cost of locally developed CAI 

• structuring CAI lessons to maximise 
local applications. 

All of this implies the need for develop- 
ment of CAI strategies aimed at cost effec- 
tive results and maximisation of educa- 
tional impact. An "engine" is required that 
will initiate and manage the C process 
for maximum effectiveness within budget 
constraints. Denholm (1984, p. 38) points 
out that "tt implement an individualised 
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learning environment with present day 
budg iting constraints or when just effec- 
tiveness of effort is sought, CAI is probably 
best applied via a Computer Managed 
Learning Program/' 

But even prior to the development of an 
'integrated' approach to computer aided 
education, Earle (1984) notes that in the 
early Ws Leibum (1981, p. 277) summa- 
rised the general benefits of Computer 
Based Teaching as : "individualisation, 
self-pace learning, immediate response 
and knowledge of results, automatic collec- 
tion of performance records/evaluative 
data, patient, tireless tutor or drill master, 
active concentrated learning, motivates 
and reinforces learning, cuts learning time, 
gives more time to instructor for providing 
individual assistance, relieves instructor of 
rote/repetitive tasks." Given that these 
benefits were well recognised, what does 
the philosophy or 'system' design concepts 
that underlie CBTE offer that is new or 
innovative? What differentiates it from 
previous developments in computer aided 
education? 

'Integrated! Functions performance 

The essential purpose of CBES is that com- 
puter performance of teaching and learn- 
ing tasks should be integrated into a com- 
puter based system of education. In practi- 
cal terms this means that separate pieces of 
software written to help perform various 
tasks in the educational environment could 
be integrated together into a software 'sys- 
tem'. The design of each task would then 
take place within an overall 'system' design 
for a computer learning environment. The 
system can then provide a set of tools that 
articulate to provide a system with the 
widest applicability to diverse course and 
educational processes in tertiary environ- 
ments. The system models the education 
process as a schematic whole, rather than 
concentrating on computerising separate 
tasks. It is the system philosophy as an 



approach to incorporating computer aids 
within the educational process which is 
important 2 . 

The approach integrates the tasks of: 

• designing courses and authoring course 
content 

• Instructing the learner (using computer 
aided teaching) 

• managing the learning process. 

Looked at in this way, the CML interface 
can help give the system a generality in 
application to diverse courses, since there 
are common tasks and task sequencing 
within this subsystem that may apply to all 
applications. An extended Computer 
Managed Learning System (CML) be- 
comes an integrating interface for other 
subsystems in the total process. It repre- 
sents an applications software product 
designed to manage learning activities in 
an educational environment. It providesan 
integrated orchestration of the learning 
environment. The CML in a functional 
sense becomes the environment in which 
learning activities are managed, pointed 
towards objectives, and in which CAI takes 
place. Th t functions it supports include: 

course authoring 
course organisation 
student testing 

instructor management facilities 
evaluation of program effectiveness 
management of student records 
integration with CAI 
communication with microcomputers 
development of courseware data base 

An integrated system can have many con- 
tributingapplications.Itisthepossibilityof 
of joining components together which 
makes them dynamic and fully of potential. 
Try (1984) includes the following applica- 
tion areas: 

• Curriculum planning 

• Curriculum management 
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• Diagnostic/Prescriptive teaching func- 
tions and Assessment and reporting 

• Catering for individual differences 

• Using the computer as a learning re- 
source 

• Administration 

CBES can provide computer support to 
educators and trainers in the development 
and routine maintenance of 
multi- resource, multi-learning environ- 
ments. To achieve this system design in- 
cludes the inherent characteristics of: 

• program independence 

• content flexibility 

• value independence 

• terminal efficiency 

• real world learning 

• courseware data base independence 

• multi-level security 

Importantly, CBES provides the frame- 
work within which instructional develop- 
ment, delivery and learning evaluation 
processes occur using computer based 
methods. 

Advantages and benefits 

The benefits of integrated computer based 
education systems are well documented in 
the literature (See for instance Rushby 
1985; Chesmond 1984; Digital 1984; Try 
1984; Sutanto 1984). These benefits may be 
classified in terms of: 

• the learner 

• the teacher 

• the organisation 

Learner benefits include: 

• curriculum targeted to his needs 

• learning programs independent of 
other learners 

• accurate and timely control of the learn- 
ing experience 

• progressive insurance of mastery over 
steps 

• efficient learning resources 

• technology training 

ERIC 3 



Using Computers Intelligently 

• a one-to-one interaction of student 
with computer 

• students can proceed at own pace 

• presents problems in logical order 

• training can be individualised 

These advantages support the learner by: 

• providing for individualised learning 
programs 

• directing and tracking learner progress 

• generation and marking of tests 

• providing feedback of results and reme- 
dial teaching 

Benefits for the teacher include: 

• maintaining records 

• providing course status information 

0 providing a framework for course de- 
velopment and organisation 

• providing a communication link with 
learners 

• managing progress evaluation and re- 
porting. 

• course material can be updated conven- 
iently 

• enhances rather than substitute for lec- 
tures 

• records student performance for assess- 
ment. 

• provides practice and remedial help 
until the desired level of mastery is 
reached. 

• student 7 s record and criticism can pro- 
vide information for improving future 
changes in course material 

These advantages combine to: 

• time saved through shifting of clerical 
and routine tasks to the computer. — 
e.g. report preparation, record keeping, 
statistical analysis and marking. 

• an integrated system means the teacher 
can focus on using the computer appli- 
cations and not be concerned about 
technical aspects of equipment or soft- 
ware management. 

• Overall, more time can be spent plan- 
ning, developing and teaching and less 
on administrative and technical tasks. 
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The benefits to the tertiary organisation 
include: 

• finely tuned curriculum or course plan- 
ning 

• flexible and adaptable course planning 
facilities measurement of attainment of 
course outcomes 

• powerful individualised learning sys- 
tems 

The desired objective arising from these 
advantages of using CBES is inceased 
educational products and better achieve- 
ment of educational objectives per educa- 
tional dollar spent. 

Educational Advantages. 

This list of benefits is a summary of those 
found in the literature. They are well 
known and add nothing new. But several of 
the potential educational benefits have not 
been explored in detail, and since they do 
arise from the uniqueness of the CBES 
approach are wortn discussing and evalu- 
ating. Two educational advantages illus- 
trate this point. 

1. Course design and implementation is 
seen as a complete learning process 
composed of educational objectives and 
particular elements that should com- 
bine into an effective learning environ- 
ment that is purposive; i.e. whose main 
objective is to achieve effective and effi- 
cient learning by the student within the 
cost and resource constraints operating 
in that particular environment. There is 
of course, nothinginherentlyineffective 
in mobilising computer based tech- 
niquesinto specific areasor tasks within 
this overall process. It happens all the 
time in computer based course author- 
ing and course management tech- 
niques. But this 'component' approach 
r.nay not encourage a 'system' view of 
ihe educational process. A view that 
sees course delivery as a rational, pur- 
posive integrated multi-task process 



aimed at effective learning. A process 
where each task or function in the edu- 
cational process meshes to produce an 
educational process greater than the 
sum of its parts. 

2. It emphasises the need to inject learning 
andeducation theory into coursedesign 
and implementation and evaluation. 
Many tertiary educators, while experts 
in their field are not educational experts 
well versed in the principles of effective 
education. This can be a perennial prob- 
lem in universities, especially in Austra- 
lia, where techniques of formal evalu- 
ation of effective teaching are not in 
vogue, as is the case in some other coun- 
tries such as USA. Thus, tertiary educa- 
tors expert in computer based technol- 
ogy, or well versed in its application to 
course situations may use computer 
facilities to aid the educational process 
in various areas without attention to 
principles of sound education. The 
danger is in perpetuating ineffective 
educational processes. 

This problem of coincidence of educational 
theory with computer technology exper- 
tise is a continuing one where computer 
aided learning processes are devised by 
individual tertiary educators in their par- 
ticular fields Use of computer power in 
particular courses may give the appear- 
ance of more learning for each education 
dollar spent, but this may be at the expense 
of the continuation of ineffective teaching 
practices. I am not arguing that this is al- 
ways the case. On balance the injection of 
computer based learning or management 
techniques into course structures and im- 
plementation might be expected to consis- 
tently lead to improved effectiveness and 
efficiency in terms of educational objec- 
tives satisfaction if for no other reason than 
that the change involves an in depth look at 
what isbeing taught, how it is being taught 
and the learning evaluation processes. The 
point is that this review and improvement 
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process may be optimised where a 'system' 
view is taken of the educational process 
which then attempts to base the total sys- 
tem design on generally accepted sound 
educational principles. 

Effective CBES systems design would seem 
to necessarily require the incorporation of 
sound educational principles. So that, to 
the extent educators use such systems in 
course preparation and management, they 
follow paradigms that take account of ac- 
cepted educational principles for improv- 
ing or optimising the learning process, 
even though they themselves may not 
possess such skills or be experts in educa- 
tional processes. If the system is based on 
such principles then the degree to which 
the course convener and presenter is 
trained in theory of educational process 
design becomes less critical to the design 
effectiveness of his courses". A CBES. may 
help to separate or disengage educational 
design skills from skills in the particular 
discipline area being taught. The former is 
embedded in the CBES, the latter remains 
the province of the course convener. 

This advantage of course, is dependent 
upon the extent to which particular CBES 
incorporate such principles and points to 
the importance of the input of experts in 
education and learning theory into the 
CBTS design process. T f CBTS is designed 
solely by information system and software 
technocrats who merely mechanise exist- 
ing course and educational structures, then 
to this extent, these benefits may not be 
realised, and the system may merely per- 
petuate ineffective teaching, learning and 
evaluation procedures. 

Limitations 

The typical limitations of CBES are echoed 
in Sutanto's (1984) reference to the limita- 
tions and disadvantages of the PLATO, 
and in an earlier but similar similar evalu- 
ation by Montanelli (1979). They stress: 

O 



Resource Costs 

• Resource requirements may be substan- 
tial, even prohibitive to Departments 
with little computer system capacity; 

• Programming requirements are oner- 
ous, especially graphics component; • 
Frequent use by substantial student 
numbers is necessary for adequate re- 
turn on investment; 

• Expense — expensive to lease TLATC 
terminal; 

• Extensive capital investment to obtain 
whole PLATO system. 

Problems of standardisation 

• Curriculum differences in specific 
courses between universities require 
courseware changes 

• Only runs on a Cyber computer system 

• Software source code not available. 

Sutanto's conclusion highlights the com- 
promise between resource limitations and 
effective education. CBES can dramatically 
improve teaching however "one cannot 
justify the extensive cost in obtaining 
PLATO system purely on a pedagogical 
ground especially with the shrinking 
budget of most Australian universities. 

Conclusions 

In the enthusiasm for computer aided tools, 
it is easy to forget that the computer is only 
one of many tools in the education process. 
The learning environment and experience 
could be deprived of much of its richness if 
the diversity of teaching/learning instru- 
ments and experience were replaced solely 
by computer based education. Such criti- 
cisms of computer dominated educational 
processes are valid. However, they are 
essentially based on a 'conflict 7 perspective 
of computers in education. The idea that 
computers inevitably replace or supersede 
other instruments; even including the 
teacher. The shadows of 1988 are still not 
far away. 
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Taking an opposite view, it is possible to 
argue that used with sensitivity and appro- 
priateness CBES may not 'conflict* with, 
but enhance the use of alternate teaching 
techniques and instruments. This suppor- 
tive role can be particularly argued in rela- 
tion to the use of computers as an integrat- 
ing tool within course design, construction 
and implementation. For example, it offers 
? possibilities for 

• Introducing sound learning and educa- 
tional principles into basic design and 
approach to tertiary courses by emoed- 
ding them within course CBES design; 

• Relieving the course convener and 
teacher of routine, recording and ad- 

1 ministration tasks; 

; J 

• improving the efficiency in course de- 
sign by giving the convener and teacher 
a basic paradigm to refer to in the de- 
sign process; 

• An underlying planning system for the 
teacher which integrates all thr tasks in 
course construction and presentation, 
while leaving the teacher free to use 
those educational instruments for pres- 
entation, learning and review which he 
sees as appropriate. 

Unfortunately, such benefits are often diffi- 
cult to quantify in money terms; and even 
more difficult in terms of money benefits 
per period. Cost is superficially more easily 
expressed in dollar terms. Consequent, 
especially in the present climate of de- 
pleted funding for the tertiary sector, it is 
the absolute cost of educational enhance- 
ments which determine priority and com- 
mitment. This applies to CBES. Unfortu- 
nately, present systems involve substantial 
initial outlay either to buy or to participate 
in a bureau type strvice through remote 
access. If CBES purchase or access could be 
made inexpensive relative to the levels of 
present day Faculty or Departmental 



budgets this may encourage wider devel- 
opment or participation. I suspect that the 
reason most CAS, CAI and CML develop- 
ments are by interested individual course 
conveners and Faculty members is the lack 
of funds to finance such initiatives out of 
Departmental teaching resources. 

Perhaps a partial solution to tfds common 
dilemma may be the introduction of less 
expensive cut-down versions of CBES 
systems for micro computers. Such ver- 
sions, while cheaper, do not necessarily 
have to sacrifice the power of the system in 
terms of tasks performed. The limitations 
are more likely to come in limitations on 
memory capacities, so they do not suit 
courses which would have extensive 
memory requirements. The key here may 
be in devising high productivity systems 
for microcomputer applications. Systems 
that are inexpensive and compatible with 
the type of memory capacity, data base 
capability and processing power now be- 
coming more widespread among Depart- 
ments as they take advantage of microcom- 
puter systems. 

Footnotes 

1 . Of course these developments may and 
have continued in parallel as well as 
sequentially. For instance, in the area of 
computer aided instruction, develop- 
ments have occurred in at least four 
CAL paradigms — the instructional 
paradigm, the revelatory paradigm, the 
conjectural paradigm and the emanci- 
patory paradigm. For details see 
Rushby (1984). 

2. This approach moves one step closer to 
a concept of a generalised expert system 
of the educational process for tertiary 
courses. 
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In recent years there has been an Increased need 
to match occupational training at all levels with 
the perceived or forecast labour requirements 
in the associated occupations. This has been 
especially so in the TAPE area. This paper ex- 
plores the theoretical aspects of matching occu- 
pational requirements to enrolments in the as- 
sociated educational programs. It then de- 
scribes an implementation of this theory in an 
interactive computer package which matches 
occupational requirements in "victoria with 
TAFE courses which lead to occupational quali- 
fications. The package has been developed for 
the Victorian TAFE Board and forecasts the 
increase or decrease in enrolments required to 
meet labour requirements in each occupation at 
the end of the century under various economic 
scenarios. These ideas can be implemented at all 
levels and would be a useful tool in University 
and CAE Careers Units as well as for Education 
planners. This paper emphasizes the design 
philosophy and other aspects of particular 
interest to Asdlite members 



In recent years th*^ has been an increased 
need in all sectors of education to match 
enrolments in specific educational pro- 
grams with the needs of our society. In 
particular there has been an attempt to 
match the resources put into education to 
the requirements for specialists in particu- 
lar areas of the labour market some years 
later when the increases or decreases in 
enrolmentsaffectthesizeof workforce. Itis 
often difficult for planners to understand 
the implications of lags in a dynamic sys- 
tem. Indeed it may prove necessary to in- 
crease enrolments in a particular educa- 
tional program to meet a target level of 
employment in some associated occupa- 
tion at some future time even if that future 
target is lower than the current employ- 
ment level. This could happen for example 



if current enrolments are not sufficient to 
meet replacement requirements. 

Economists are concerned with matching 
supply and demand, but there have been 
few attempts to do this in educational plan- 
ning because of the difficulty of matching 
specific occupations to specific educational 
programs. 

This paper describes such a match and 
discusses both the theoretical considera- 
tions and the practical difficulties associ- 
ated with such an exercise. These ideas are 
then incorporated into a practical micro- 
computer implementation which is de- 
signed to work on an IBM style personal 
compu ter and could be easily implemented 
on any other machine. The program pro- 
vides a host of facilities which would be 
useful not only for planning purposes but 
also as a resource for career counselling 
units. 

Program Planning Requirements in 
Technical and Vocational Planning 

The system described in this paper, while 
generalizable, relates specifically to the 
provision of technical and further educa- 
tion in Victoria and to the associated occu- 
pational groupings in Victoria. 

The Victorian TAFE system, in common 
with the rest of Australia, offers a wide 
range of courses through schools, colleges 
and adult education authorities. These 
courses may be classified into six streams: 
professional, para-professional, trades, 
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other skilled, preparatory and adult or 
further education. In 1985 there were 
330,000 persons enrolled in these six 
streams, the largest stream being adult 
education with 131,000 enrolees, while 
31,200 were enrolled in the basic trade 
stream. The trade stream is exclusively 
apprenticeship in nature and accounts for 
nearly one-quarter of total contact hours. 
This stream leads to trade qualifications 
and registration and is the subject of this 
study. 

The basic trade stream comprises some 1 17 
separate courses which lead to 52 pro- 
claimed trades. Individual course enrol- 
ments can vary from a handful of students 
studying at a particular location to courses 
such as motor mechanics which can have 
thousands of students enrolled at dozens of 
diffeient locations. 

The size and complexity of the TAPE sys- 
tem in Victoria - an annual recurrent 
budget of over $200 million, 17,500 staff 
(6,300 full time), 32 colleges and 600 smaller 
providers - creates significant co- ordina- 
tion, management and planning problems. 
Apart from the size and complexity of the 
system, the high degree of autonomy of the 
colleges, the main providers in the trade 
st*w obviously exacerbates these prob- 
lems. 

Since 1981 when considerable autonomy 
was granted to the separate colleges, TAFE 
has had to revise its planning processes. 
Part of this process is the development of a 
management information system to pro- 
vide the necessary data for its internal 
needs. The system discussed here is a key 
element in this system. 

Educational and Occupational Trends 

Asabout 70% of TAFE's recurrent budget is 
devoted to its vocational activities, it is 
obvious that a more effective and efficient 
system will necessarily take into account 



labour market data in planning new pro- 
grams or in expanding or contracting exist- 
ing programs. The trades group of courses 
to a large extent require specialist facilities 
and staff who can not easily be reassigned 
to other programs. Hence significant 
changes in the mix of occupational require- 
ments in die community will have signifi- 
cant implications for these 'facilities 
bound' training programs. 

It was realised that projections beyond the 
year 2000 would not prove very useful in 
practice, hence the design philosophy was 
to develop a system which examined a 15 
year 'planning period' beyond the base 
year. On the understanding that there 
would be continued revisions of future 
occupational requirements projections for 
trade and technical groups a base set of 
projections were required. These were 
found in a study of industry and occupa- 
tion work force forecasts for Victoria under 
various economic scenarios for the 1990' s. 

In this analysis four different macro-eco- 
nomic growth scenario are available. These 
are 

1. parity with OECD growth 

2. parity with world growth 

3. parity with high world growth 

4. parity with low world growth. 

These different growth scenario together 
encompass the rangt .V . pessimistic t 
optimistic estimates and hence in the final 
model provide a sensmvity analysis for 
various kinds of growth. 

It must be stressed estim? tes of occu 
pational requirements are not measures of 
occupational demand as they do not in- 
clude any replacement demand. These 
occupational requirements indicate only 
what work force skill composition will be 
needed if the growth and output levels are 
to be attained. To estimate occupational 
demand the age composition of the work 
force was used to generate a Markov re- 
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placement process, and details of this are 
given below. 

Units of Analysis 

The fundamental difficulty with linking 
occupational requirements with training 
programs which lead to these occupations 
is that there is not a one-to-one relationship 
between these two sets. Under any of the 
classifications of occupations there are 
some which have no associated instruc- 
tional program in the TAFE system, some 
have one associated instructional program 
and others have more than one instruc- 
tional program. On the other hand there are 
some TAFE programs which lead to more 
than one occupation. The concept of a 'unit 
of analysis' has been developed to allow a 
rational linking or cross walking 7 of c :u- 
p^tioru groups and instructional pro- 
grams. 

A unit of analysis is a mapping which asso- 
ciates groupings of educational/ training 
programs, itaving common curricula and 
objectives, with the related occupations for 
which they prepare piogram participants. 
The development of this mapping or set of 
units of analysis is central to any attempt to 
link occupational supply and demand 
data. The absence of such an interface 
means that the separate elements of data 
collected on the supply and demand sides 
of the labour Market are of limited use for 
program planning. Indeed, such a link is a 
necessary p;e-requisite for any considera- 
tion of supply-demand balances for re- 
gions and occupations. Of course there isas 
much art as science in determining this 
mapping and it is sometimes necessary, on 
the grounds of either utility or empirical 
validity to discard some occupations, and, 
more rarely, instructional programs from 
either the range or the domain of the map- 
ping. These issues are pursued in the report 
to the TAFE Board. 



Units of analysis are formally classified as 



follows: 

Type I — one program and one related 
occupation 

Type II — one program and several related 
occupations 

Type III — several programs and one re- 
lated occupation 

Type IV — several programs and several 
occupations. 

A complete supply- demand interface will 
clearly contain, in general, all of the above 
types of units of analysis. Previous at- 
tempts at similar analysis have been re- 
stricted either to a single education- train- 
ing program based supply-demand inter- 
face (Types I and II only) or to or a single 
occupation based supply-demand inter- 
face (Types I and III only). Both of these 
formats force the user to impose breaks by 
excluding certain occupations from par- 
ticular programs. Often the excluded occu- 
pation-program groups are those streams 
with the largest enrolments. Our approach 
makes no exclusions on the grounds of 
analytical expediency, although we have 
made some minor exclusions where no 
data or surrogate data is available. 

Career Progression and Replacement 

Unlike some other countries there is a 
dearth of data in Australia on student pro- 
gression rates, post-program labour force 
entry experience, occupational mobility 
and labour force withdrawal for trades 
based training programs and occupations. 
Some studies have attempted to describe 
tradesperson's career paths but unfortu- 
nately aggregate over trade groups and 
provide significantly different progression 
rate estimates. There is a significant gap in 
our knowledge of the immediate post- 
trade training entry experience of indi- 
viduals. A further major gap lies in our 
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knowledge of progression iai,^ by year or 
level through the apprenticeship program 
itbelf. 

In this study the estimates of year-to-ye ir 
progression rates are derived from enrol- 
ments over the last few years. TAFE has 
only collected comprehensive enrolment 
statistics on a regular basis since 1981 and 
this period has also seen a rapid growth in 
the variety and size of trade related pro- 
grams. At this stage it is not possible to 
track students over time so our year-to- 
year or level-to-level survivorship rates by 
trade stream category are necessarily nta- 
tive. TAHi is currently supporting pilot 
longitudinal tracking studies, but the par- 
tial information which does exist indicates 
not only considerable variation between 
courses but also that these progression 
ratesar e sensi tive to external labonr market 
conditions and vary considerably, from 
year to year. Our system enables the user to 
™odify these progression rates for each 
trade course, and of course this allows an 
experimental determination of the sensi- 
tivity of the predicted required enrolments 
to variations in these progression rates. 

The entry rates to the trades following 
training are even less well understood. It is 
clear from Sgro's study that demand is 
sensitive to wage levels but our estimatesof 
this entry rate, while plausible, have little 
empirical evidence to support them. Once 
again these rates are able to be modified by 
the user and experimentation with differ- 
ent rates is possible. 

There is also a limited amount of informa- 
tion available on the career paths of trade- 
spersons. It is very difficult to obtain any 
estimates of suu\ key variables as: the pro- 
portion of trades qualified persons who 
have never practiced their trade, the age 
specific proportions of practicing trade- 
spersons who stop using their trades skills 
and the age specific rates of permanent 
work-force separation. Certainly this infor- 



mation is not available at the level of indi- 
vidual trades but a recent ABS survey pro- 
vides some base line data which enables us 
to make some preliminary estimates. 

This survey by the Australian Bureau of 
Statistics is an Australia wide multi-stage 
area sample of private and non-private 
dwellings. The sample size and the nature 
of the survey limit its usefulness at the 
individual trade level, but it does provide a 
valuable framework. Of the more than one 
million trades qualified persons in Austra- 
lia only 56 percent were employed or work- 
ing in their trade or were using some trade 
skillsintheirpresentoccupation. Other key 
findings, from the point of view of our 
analysis, we;? that : 

this figure of 56 percent varied mark- 
edly from trade to trade (from 8 per- 
cent in footwear, clothing and textiles 
to 71percent in the electrical trades), 

an estimated 5 percent had never 
worked in their trade, 

the proportion still practising their 
trade declined sharply with age, 

by age 25 approximately one quarter 
have left the trade. 

Other studies cast little light on these statis- 
tics, some providing similar estimates and 
others contradicting this study. All of these 
other studies were smaller in scope and size 
and provide only partial estimates. Once 
again the facility has been provided in the 
computer program to undertake experi- 
ments by varying the consequent cohort- 
to-cohort progression rates. 

In the ABS career path survey age specific 
retention rates are given for age cohorts, 
most of which span 10 years. These pub- 
lished rates for each trade have been sub- 
jected to a sixth order filter with the appro- 
priate boundary conditions in our study. 
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This process provided estimates of reten- 
tion rates in the first few years in the trade 
and subsequent analysis matched the re- 
sults obtained using ten year cohorts. This 
approach has the disadvantage of being 
relatively arbitraiy but appears to give 
robust results in conformity with the pub- 
lished data. There is, however no way of 
extracting from this data transition proba- 
bilities from the training program to the 
trade. The question of later entry to the 
trade is, of course, no problem since we are 
only concerned with modelling effective 
retention rates. Sensitivity analysis, either 
experimental or theoretical, provides some 
measure of how critical these potential 
inaccuracies are to the final estimates. A 
series of cross-sectional analyses at differ- 
ent times could also provide some esti- 
mates but to our knowledge no such study 
has been done. 

Modelling Throughput 

The methodology behind our analysis is 
general systems theory, a branch of mathe- 
matical analysis which includes the theory 
of Markov processes. Initially we assume 
that the parameters which describe the 
system are invariant over time, but this is 
relaxed in the most general implementa- 
tion of the analysis. In practice it is a rela- 
tively straightforward matter to determine 
whether this restriction to an autonomous 
system is critical. 

Systems theory relates the output of any 
system, in this case thenumber of qualified 
tradespersons in any future year, to the 
inputs to the system, in this case the num- 
ber of entrants to the appropriate TAFE 
prograni or programs. The state of the sys- 
tem is the number of tradespersons or 
apprenticesof each agein each trade group, 
which is denoted by where the subscript i 
denotes the industry, the subscript j de- 
notes the level in the instructional program 
for j » v 4 and the number of years in the 
industry for j = 5,...,15 ( j = 5 corresponding 



to the first cohort, j = 6 to the second etc.,) 
and k denotes time. In the present formula- 
tion k s 1 corresponds to 1987, but this is 
easily changed. 

The dynamics of the process are deter- 
mined for each industry by the matrix of 
transition probabilities whose jl -th entry 
is the survival probability from state j to 
state 1 at timek, and the inputs to the system 
by the vector whose entries correspond 
to new entrants to the system into the level s 
of the TAFE course or into age the cohorts 
of the trade occupation. 

The process is then completely specified by 
the equation which enables us to predict 
the number of tradespersons or appren- 
tices at any given level or in any age cohort, 
employed in industry is at anytime from 
the present: 

Making the calculations determined by the 
preceding equation is considerably simpli- 
fied because of the special nature of the 
Markov transition matrices and , as 
mentioned above, we initially make the 
additional simplifying assumption that the 
transition matrices are invariant over time. 
However the advantage of the above gen- 
eral formulation is that entrants to the in- 
dustry other than first year TAFE trainees 
can be incorporated. There are some fur- 
ther technical difficulties associated with 
matching single year cohorts in the TAFE 
program with a mixture of five and ten year 
cohorts in the trade but those details will 
not be discussed here. 

From this general formulation it is not dif- 
ficult to determine retention rates and age 
specific profiles for each of the trades and 
more importantly, in tern^, of later eco- 
nomic analysis, the average working life in 
the industry for each of the trades in ques- 
tion. These calculations also provide a veri- 
fication of the estimated transition proba- 
bilities in each trade by the following con- 
sideration. The system can alternatively be 
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modeled on the basis of retention rates and 
the transition probabilities in equilibrium 
determined as the Frobenius-Perron maxi- 
mum eigenvalues of the dynamic system 
determined by the retention matrix. This 
alternative formulation provides an heu- 
ristic verification of both the analysis and 
the data. 



This analysis is then used to provide esti- 
mates of required enrolments in the TAPE 
instructional programs associated with 
each unit of analysis to achieve specified 
target numbers jf tradespersons in the 
associated occupational group at some 
specified future time. There are obviously 
many different adjustment processes but 
only two are implemented in our formula- 
tion of the model. These are 



commencement of the pi ogram, and enrol- 
ments in the last four years do not affect 
target occupational levels. It seems sensible 
therefore to reduce enrolments in the last 
four years to replacement levels. However 
in some cases this would produce drastic 
enrolment changes which could not be 
accommodated by the system. 

Structure of the Program 

The implementation of the above theory 
and associated practical considerations has 
resulted in a Turbo Pascal program which 
serves an eightfold purpose. The program 
has been designed to be used interactively 
and provides a fast, user-friendly opera- 
tion. It is completely menu driven and 
requires no user manual, at least for the 
target audience of TAFE officers. 



The first objective was to provide an easy 
introduction to the concept of units of 
analysis and to allow these to be accessed 
firstly from one of the associated occupa- 
tions, either from the older Australian Clas- 
sification of Occupations (NCO) or from 
the new skill- based Australian Standard 
Classification of Occupations ( ASCO), sec- 
ondly from any of the associated TAFE 
ia? ! * actional programs, and thirdly di- 
rectly from the unit of analysis itself. The 
pi ogram displays the complete identifica- 
tion associated with the unit of analysis, 
detailing the official codes and titles for 
each element of the map. Help screens are 
built ^to the system to provide sufficient 
information for the first-time user. 

The second objective v/as to provide a 
complete easily accessible catalogue of all 
of the ASCO and NCO trade classifications 
and all of the trade related TAFE training 
programs. This catalogue allows the user to 
browse through these lists for whatever 
purpose or to select an associated mapping 
or congruence from any entry in the cata- 
logue. 



a. a constant annual increase or de- 
crease, as appropriate, in first year enrol- 
ments, that is, where E is the constant an- 
nual increase in first year enrolments, and 

b. a constant annual rate of increase or 
decrease, as appropriate, in first year 
enrolments, that is, where r is the con- 
stant annual rate of growth of first year 
enrolments. 

Both of these growth scenario are useful to 
the planner. The first requires a constant 
annual increase in accommodation, equip- 
ment, staff and resources while the second 
requires a constant annual percentage in- 
crease in accommodation, equipment, Jtaff 
and resources (when growth rather than 
decline is predicated). Both approaches 
have their adherentsin planning. However 
in the caseof a substantial adjustment to the 
enrolment numbers being necessary it is 
important to understand that the second 
scenario will, in general, create the largest 
overshoot. This is particularly the case for 
those uniis of analysis with a four year 
apprenticeship. In this case, increased en- 
rolments do not begin to affect the stock of 
tradespersons tir*til tour years after the 
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The third objective was to provide on-line 
access to a statistical data base relating to 
the total number of tradespersons in any 
trade group, the age distribution of these 
tradespersons, the career transition proba- 
bilities and survival rates across age co- 
horts, the enrolments at each level of each 
TAPE trade course in the base year, the 
transition probabilities from level to level 
and from the final year to the trade. 

The fourth objective was to forecast target 
occupation levels for each occupation 
group in 1995 and 2000 on the basis of four 
different economic scenarios for Australia, 
and to relate these targets to the units of 
analysis. 

The fifth objective was to analyze the given 
data to de< -mine the required enrolment 
levels over some planning period to meet a 
selected target number of tradespersons 
employed in the selected trade, either in a 
scenario of constant growth or of a constant 
growth rate. 

The sixth objective was to determine the 
replacement requirements for a particular 
target occupation under a chosen growth 
scenario, the average age and the age distri- 
bution of tradespersons at the terminal 
time. It is important to emphasize that since 
this analysis is to a large extent concerned 
with disequilibrium adjustment processes 
then replacement requirements, the aver- 
age age and the age distribution of trade- 
spersons will vary from year to year. 

The seventh objective was to allow all of the 
parameters in the model to be modified by 
the user either for the purpose of conduct- 
ing experiment sor sensiti vi ty : - alysis or of 
modifying the parameters as calculated 
from other studies or available data. 

The eighth objective was to enable the 
addition of further occupations and train- 
ing programs and the consequent defini- 



tion of additional units of analysis, if it 
proved necessary. 

Conclusion 

The program as demonstrated at Calite-87 
fulfils the first seven of the objectives speci- 
fied above although the author has deemed 
it expedient not to provide access to the 
parameter modification module at this 
stage. The nature of non-autonomous 
dynamics is not easy to understand and 
some slclls are required to interpret data 
from the simulation of such systems. The 
program has been designed to allow the 
easy incorporation of additional occupa- 
tions, instructional programs and further 
data but some modification to the source 
code will be necessary. 
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Twelve years ago I purchased some BASIC list- 
ings of drill and practice computer programs. 
This year I am involved in the production of an 
interactive videodisc This paper describes 
some of the experiences and knowledge gained 
in the intervening years. It describes computer 
based education packages which have worked 
and some which have not, when CB.E. has been 
useful and when it has been a disaster, which 
authoring languages have been found to be 
helpful and which have been a waste of time. 
Examples win be given of drill and practice, 
utilities, tutorials and simulations. And finally- 
has it all been worthwhile, and where do we go 
from here? 



At a symposium reported in the Journal of 
Chemical Education entitled "Will Com- 
puters Replace Teacher Aids?, Professors?, 
Labs?, Should They?", participants were 
leaders in the field of computers in educa- 
tion. Theyalludedtothecomputerasatool 
and as a new medium of instruction. There 
was general agreement that the computer 
provides new ways of approaching prob- 
lems, but the consensus was that the com- 
puter is a tool and that good teachers can- 
not be replaced by a computer. 

I first became interested in using comput- 
ers as an aid to teaching about twelve years 
ago after a visit to Australia by Prof. Bitzer 
of PLATO fame. This, not surprisingly, 
coincided with the purchase of a CDC 
Cyber computer by the S.A. Institute of 
Technology making the use of a computer 
possible in the general teaching sphere of 
the Institute. Since then I have followed a 
tortuous path through macros, minis, mi- 



cros, and a multitude of methodsof author- 
ing. I have been encouraged, discouraged, 
helped and obstructed. I have, as Marvin 
Minsky indicated to us two years ago, suf- 
fered the relearning process. At the end of 
it I realize we have come but a short way in 
the use of computers in the education 
scene. The information revolution is only 
just beginning and CD-ROMS, Interactive 
Videodiscs and satellite communications 
are opening up a whole new horizon of 
possibilities in education. Some of these 
possibilities we are aware of, but others we 
have no more knowledge of than the office 
clerk of the nineteenth century had knowl- 
edge of the word processor, database and 
spreadsheet. Just as they are tools of busi- 
ness so are similar packages tools for the 
teacher, and just asbusinessand commerce 
proceeded with the abacus and steel knib- 
bed pen so the teaching process should 
proceed with the tools that are available 
now. We cannot afford the luxury of wait- 
ing. Waiting for the ultimate teaching tool. 

So this paper is not full of the latest in 
teaching technology which will turn the 
educational establishmen t on i t s ear . In a ny 
case education is too conservative for that. 
What it intends to do is to help take a little 
of the suffering and some of the drudgery 
out of the teaching process, and in so doing 
take some of the drudgery out of the learn- 
ing process. It might even provide ideas to 
make students think (a revolution in it- 
self!?) and provide time for the teacher to 
deal with individual student problems. 
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Philosophy 

My philosophy as to whether to use com- 
puter software materials is based upon the 
following proposition. 

Use it if it: 

• enriches the course and if time is avail- 
able 

• saves the teacher time and doesn't dis- 
advantage the student 

• motivates the student to do well 

• saves the student time by speeding up 
tasks or supplying information. 

Purposely left out is the one of cost effec- 
tiveness. Thisisalwaysacontentiousissue. 
Are libraries, laboratories, photocopiers 
etc. cost effective a£ teaching tools or just 
traditionally desirable? I would question 
the purchase of a large computer system 
just for computer aided learning tutorials 
and drill and practice, but there are so 
many more things that can now be done 
with computers to make life easier for the 
student and educator. One must consider 
all these things if one is to consider cost 
effectiveness. Frankly I consider such an 
exercise as useless as trying to evaluate the 
cost effectiveness of a specialist book col- 
lection in a major reference library. 

One last point in the philosophy of using 
computers in education is the fun of it. God 
knows one needs a sense of humour to be in 
the education profession at all and if using 
computers can contribute towards the out- 
let of that sense of humour so much the 
better. Learning should be fun it is the 
unlearning that causes the suffering and 
that comes later. 

The Programs 

a. Time savers - 

1. Calculation checks 

These have been used to date in two main 

areas. The first is to check students practi- 

O 



cal work. In our large first year practical 
classes one of the terrible time consumers 
for the instructor is "marking practicals". 
Student calculations are notoriously unre- 
liable. So if one comes across a "wrong'' 
result at the end of a practical report the 
questions arise; is it bad laboratory tech- 
nique, use of the wrong "formula", or 
straight out arithmetic (calculator) incom- 
petence? Since in my view the instructor is 
there mainly to teach correct laboratory 
technique time should not be wasted on the 
other two. So a suite of programs has been 
written to check the students' calculations. 
Such a calculation check is required before 
a report is submitted for assessment. The 
student is prompted to input his/her ex- 
perimental values, and then the final value 
which the student has calculated. 

The program then tells the student whether 
the calculation is correct to within the limits 
set by the instructor, is close to that value or 
is very wrong. It does not say whether the 
final value is correct in a practical sense. 
When I first introduced this over 50% of the 
students were making calculation errors at 
the first attempt. Of course they all blamed 
the computer until they recalculated and 
got it "right". By the end of the first term 
few errors were being made. 

Not having to search for calculation, trans- 
position or formula errors can reduce 
marking time by up to 50%. 

One of the spin-offs of this was the discov- 
ery that students have a bad habit of round- 
ing off intermediate values during a calcu- 
lation. This can cause large errors in final 
values even when using calculators. So 
now advice is given early in the course on 
the inadvisability of rounding and the 
importance of the order in which computa- 
tions are carried out. Those who do not 
listen suffer the consequences. 

It is also noticed that students usually check 
their calculations in small groups, and er- 
rors are often picked up by their peers and 
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connected quickly, and at a time when the 
corrections are relevant to the task in hand 
and not say a week later when reports are 
marked or handed back. 

The second area in which this technique 
has been used is for assignment checking. 
This has allowed more assignments to be 
set and marked resulting in better detection 
of specific weaknesses in first year stu- 
dents. 

2. Individualized Assignments. 

Again not a new idea, but a great time saver 
and student motivator. Sets of individual- 
ized numerical problems are produced 
using a random number generator. These 
are printed complete with an answer sheet 
for each student. A set of answers for each 
set of problems is printed for the instructor. 

It takes little time to mark the answer sheets 
for each student and blind copying is elimi- 
nated. Peer help is encouraged since, firstly 
it saves the instructor time, and secondly, 
experience has shown that "lazy" students 
do not get the problems done for them- 
Also answers cannot be passed down from 
one year to the next, a practice common 
with students for generations! 

Such techniques as the above have been 
used for some years at the University of 
Texas at Austin to "cope" with 800 first year 
chemistry students. 

3. Drill and Practice. 

Now once again finding favour with edu- 
cationalists, drill and practice is used exten- 
sively as pretest sessions for a self paced 
first year Chemistry course. Each of the 20 
units of the course requires, apart from the 
completion of an ^assignment, a test to be 
passed based on the conten ts of a chapter of 
the recommended text. The pass mark is 
about 90%. The computer sessions include 
all the questions that a student is likely to be 
asked in a test. Incidentally no two testsare 
exactly the same and a student can repeat 



341 

the testing process until mastery is ob- 
tained. Students soon realize that time 
spent using the programs saves much time 
later. 

This emphasizes an important principle of 
the use of computers in education. The use 
of the computer must be seen to serve a 
useful purpose and not just "nice to do". In 
this case passing the test first time after 
proper preparation is a tangible goal with 
concrete benefits. 

The tests themselves are not given at the 
computer terminal. The reason for this is 
that the taking of tests and the immediate 
marking of them gives an important con- 
tact between instructor and student, and 
allows subtle misconceptions about the 
subject matter to be dealt with at the time. 

4. Utility Packages 

Commercial programs such as word proc- 
essors for reports, statistical packages for 
processing laboratory results etc. are being 
used more and more by students as they 
become convinced of their time saving at- 
tributes. One longs for the day when all 
reports, essays and assignments will be 
submitted perfectly typed with no spelling 
errors. 

a. Simulations 

These are used to illustrate theoretical 
concepts when they are first encountered 
so freeing laboratory work from being 
timetabled to fit in with lecture material. 
These simulations are not intended to be 
substitutes for work in the laboratory. 

A simulation of enzyme kinetics is used as 
a follow up to a laboratory experiment 
where time constraints do not allow all the 
experimental variables to be investigated. 

A simple nuclear chemistry simulation is 
used as a substitute for a laboratory experi- 
ment. In this case it is desirable that the 
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students appreciate the unique laboratory 
principles, but facilities to mount the ex- 
periment are not available for reasons of 
cost. 

Apart from the value of allowing students 
to apply theoretical knowledge (or lack of 
it) these simulations have highlighted the 
need for students to gain experience in 
planning their own experimental work. In 
most scientific laboratory sessions all the 
planning has been carried out by the in- 
structor in order that the experiments 
should "work". In other words the student 
is left with a recipe to be followed slavishly 
without real understanding of the con- 
cepts. This delights the student and makes 
practical courses run smoothly, but leaves a 
gap, The computer simulation is an ideal 
vehicle for training in organization and 
planning as a wrong plan does not waste 
valuable materials and equipment and, 
since simulations produce results rapidly, 
time is also saved. 

Simulations are also used as animated 
examples in lecture and tutorial classes 
allowing a freedom to "see what happens 
if", and to encourage student involvement. 

There have been simulation packages 
which have not been successful. One rea- 
son for this has been that the simulation 
itself has been too close to reality and has 
wasted time in repeated animation when 
quick results was the objective. Again we 
come back to the timesaving aspect of 
computer based education. 

c. Others 

No mention has been made of computer 
generated tutorials. My experience so far is 
that these are resisted by the average stu- 
dent as a waste of time. They regrettably 
can see no point in doing a program be- 
cause it "it is good for you" . Of course those 
students do not read their text books and 
references for the same reasons, and only 
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look at duplicated notes if they think an 
exam question is hiding in there some- 
where. 

We must not think that the use of comput- 
ers in education is going to have a dramatic 
effect on the behaviour and attitude of stu- 
dents towards their own education. Of 
course a well produced piece of course- 
ware presented at the right time in the right 
context will stimulate and motivate stu- 
dents, but no more than the same material 
well presented at the right time and in the 
right context by a teacher. The computer is 
still a tool and a tool which is rapidly losing 
its awe to the student population. In fact 
computers are getting a "bad press" be- 
cause popularly they are being blamed 
more and more for the errors of their users. 

So in general I only use computer gener- 
ated tutorials for specific cases of difficulty, 
and even then find some resistance to their 
use. 

Authoring Systems and Languages 

At present I use PC-PILOT on an IBM-XT 
compatible microcomputer with a hard 
disc, and colour of course. I have had 
experience with several other authoring 
type systems namely STAFF and DAL on 
mainframes, and PILOT, ENBASIC, Q, 
QCAL, PAL and MICROTEXT on micro- 
computers. 

The reason for choosing to use PC-PILOT is 
partly subjective as is the choice of author- 
ing systems by most people. In my case I 
needed a system for the IBM microcompu- 
ters which are available for student use at 
the S.A.I.T. I also needed a system with 
good graphics, a choice of colours and 
fonts, good string handling routines and 
good mathematical capabilities. I was not 
so concerned with computer managed 
courses although PC-PILOT has this capa- 
bility at an elementary level. 
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I was not interested in an automatic pro- 
gramming system as my previous experi- 
ence with such facilities had shown them to 
be restricting in the long term and lacking 
in flexibility. Such "filling in the blanks" 
systems look very attractive to a newcomer 
to authoring, but unless one can break out 
of that stage easily one soon becomes frus- 
trated with the restrictions imposed. Actu- 
ally PC-PILOT does have such a facility 
with the advantage that it produces the 
source code which can be manipulated 
later as one's experience grows. After some 
two years working with PC-PILOT I have 
now developed a collection of screens and 
routines which I use extensively giving me 
considerable flexibility. 

PC-PILOT is a system which uses a simple 
text file created with a very good screen text 
editor. This contrasts with other authoring 
systems which are menu driven. Which is 
the best system I think is a matter for the 
user to decide. I prefer the text file probably 
because I am used to it and can easily visu- 
alize the lesson screen from the text file 
screen. I haveateo used a ram-disc and now 
a hard disc to switch quickly from the text 
file edi tor to the PILOT driver and so see the 
lesson asitdevelops. lean also pull in from 
my library collection, screens and routines 
which develop the lesson rapidly and with 
few errors. These routines include such 
things as matching tests, multiple choice 
question screens, true/ false routines etc. 
and a lesson shell which sets up special 
characters for chemical symbols, windows, 
timing and marking macros. So I have 
probably reached the point where to 
change to a new and possibly more efficient 
system would be. resisted because of the 
mass of material already developed and 
the chore of learning a new routine. 

I have tried to concentrate on the positive 
aspects of the choice of an authoring sys- 
tem, and do not wish to dwell on the nega- 
tive aspects of other systems, since as I have 
said, the choice depends upon what you 



want to do arid upon your personal prefer- 
ence for the type of system you wish to use 
which will be coloured by your previous 
experience. 

It is important however that, when evaluat- 
ing a system; one makes sure that it is the 
latest version as software development can 
be rapid, and a system which in its first 
form may be primitive can, in version two, 
be just what one is looking for. Evaluations 
of authoring systems could be one area for 
consideration by ASCILITE with perhaps 
evaluation copies of the software and 
manuals available for short term loan by 
members along with a list of user contacts. 
Such a service would be invaluable to the 
new author and the more experienced user 
looking for alternatives and updates. 

And in the future ... 

My personal future will be to write more 
and obtain more of the types of courseware 
which has worked in the past. New things 
to write not mentioned above are pre and 
post laboratory tutorials and tests, past 
exam paper help and tips,and a suite of 
support programs for disadvantaged stu- 
dents, and I have to program and test that 
videodisc we have just produced. 

I shall also continue to buy, borrow (but 
never steal) as much CBE material as pos- 
sible because this is infinitely faster than 
writing it. And if the material is not exactly 
as I would like it I am quite prepared to 
slightly change what I do to fit the material, 
and if the material is good it will not do any 
harm. 

The future of computers in education is 
assured, but the future of computer based 
education or computer aided learning or 
computer assisted education or whatever it 
is called will continue to be a rocky one. My 
experience over the years has seen com- 
puter based education greeted with enthu- 
siasm by a few, treated with apathy by 
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many and met with opposition both open 
and subtle by a surprising number of edu- 
cators. It is a pity that not enough teachers 
see computers as the tool for better educa- 
tion, and a tool to be mastered not ignored 
or thrown aside. 

The rapid technological advances in the 
fields of information exchange and storage 
are about to have a dramatic effect on the 
way we live. A flood of videodiscs and 
compact disc storage devices are about to 
appear and educators should be ready to 
take advantage of the wealth of informa- 
tion soon to be at our fingertips. This tech- 
nology will never replace the teacher, but if 
used with intelligence, will give the teacher 
the time and freedom to give students the 
quality of education too often missing in 
our Schools, Colleges and Universities. 

The immemorial problems of teaching 
endure but at least we have been 
vouchsafed a marvellous new tool 
with which to chip away the darkness. 
Derek Davenport. 
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The availability of computer managed learning 
material has been extended to students enrolled 
in Associate Diploma in Engineering course 
and, in particular to students enrolled in elec- 
tronics. The CML component comprises test 
instruments/ facility to report home-based prac- 
tical exercises, and circuit construction simula- 
tions. Two modes of operation are available - 
interactive in study centres and home, and mail- 
in mode. Some evaluation of student reaction to 
the CML component has been made. 



Acceptance of distance education models 
has added impetus for new approaches to 
teaching. This impetus, together with 
expanding availability of new technology, 
has generated new bases tor the support of 
learning. The Darling Downs Institute of 
Advanced Education (DDIAE) commis- 
sioned its computer managed learning 
(CML) system in 1984. The system added a 
powerful component to the range of media 
available for the production of learning 
packages. 

Computer Managed Learning. 

The term computer managed learning is 
applied to embrace the facets of testing and 
instruction. The application has allowed 
the system to support not only assessment 
and instruction but to manage reports of 
laboratory exercises. Adoption of a nar- 
rower definition would have limited the 
application of the medium. 

The system interfaces with three data bases 
- student records, assignments and CML 
content. The latter allows on-line or batch 
input of module content. The assignment 



data base contains unique identification of 
all current assignments, weighted and non- 
weighted, together with descriptors, dates 
and assessment weightings. All CML test 
suites form part of this data base. The 
student records interface allows updating 
of academic progress. The system itself 
stores responses to each test item, giving 
the opportunity for item analysis. Produc- 
tion output is in print and diskette formats. 

Test suites are designed to incorporate 
items of multiple choice, exact answer, 
answer within a range, answer within a 
sequence, one of a number of answers, 
some of a number of answers formats or 
any combination of formats. A feature is 
thy guidance of students depending upon 
their performance and the supply of feed- 
back specific to student's response. The 
figure below details the basic structure of 
each test suite. 

Students elect to use the system interac- 
tively using microcomputers and diskettes 
or via a mail-in mode which is processed on 
campus. Mail-in operation provides the 
same feedback for tests and experiment 
reporting as the interactive mode. The 
computer assisted instruction (CAI) pack- 
ages are available for interactive use only. 
Student access to the interactive mode is 
located on-campus, at study centres and, to 
a limited degree, at home. Selection of the 
mode of operation is made at the beginning 
of each semester. 

Operation at study centres and on-campus 
utilises three diskettes. A student diskette 
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Figure 1 : Key Elements of Computer Managed Learning 
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Figure 2 : CML Interface with Data Bases 
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which contains enrolment data, security, 
system access records and test results also 
contains the operating system. A content 
diskette holds test suites, experiment re- 
porting formats and CAI material. A 
"mail" diskette has access and result data 
transferred to it and is used to update files 
on the student record base. 

The CML system embodies fundamental 
principles. The medium is used as a man- 



agement tool. The areas of instruction and 
testing are clearly identified. Progress is 
repeated instantly; feedback is specific; 
remedial guidance is immediate. Within 
the constraints of assignment management 
self-pacing is possible. The remainder of 
this paper addresses the application of the 
principles to Electronics, in particular to 
the areas of testing, reporting and instruc- 
tion through simulation. 
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Figure 3 : CML System - Student Activity Interface 
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Figure 4 : Location of Study Centres 




Testing 



Testing is done by providing banks of 
questions, most of which are multiple- 
choice. About two-thirds of the questions 
are numerical, or calculation basea, the rest 
being of a more descriptive nature. In 
electronics, a lot of reference must be made 
to graphics such as circus diagrams and 
timing diagrams, and also to detailed data 
sheets such as those for integrated circuits. 
It is also important that students see these 
in their printed form, since tlus is the nor- 
mal way they are available. So, even 
though/ it is possible to provide ..eseon 
screen, students are referred to printed 
material. (This is also necessary for stu- 
dents without access to a computer). 

Students require one to two hours of effort 
to do one of the twenty two tests provided. 
Three of these are nominated to be summa- 
l*ve, with a total of twenty percent of the 
marks for the unit allocated to them. The 
remainder are optional. This approach was 
endorsed overwhelmingly by students 
v/ho were questioned. They appreciated 
the fact that test questions covered every 
part of the work, and they did use the 



optional questions as preparation for ex- 
aminations. It provided them with a means 
of self-assessment, and, in the case of the 
summative tests, forced them to work thor- 
oughly in searching for answers. 

In spite of the appreciation expressed by 
the students, they felt that the amount of 
feedback provided on incorrect answers 
was not as great as it could have t>een. 

Some security against students using re- 
sults from other students in previous years 
is given by providing several tests, and 
changing the one specified as summative 
from year-to-year. 

Experiment Reporting. 

While many students are employed in situ- 
ations in which equipment is available to 
them, there are some who are very limited 
by lack of such equipment. The electronics 
experiments have therefore b**or. designed 
to be done on the kitchen table, with very 
simple and inexpensive equipment, typi- 
cally just a power supply and simple multi- 
meter. This system works very well and 
few students have difficulties, even though 
most are working alone. 

The experiments are usually the assembly 
of a circuit end a series of measurements on, 
or changes to it. Very careful instructions 
are given to ensure that the circuits do 
work, and in ninety percent of cases, stu- 
dents have no trouble achieving basic cir- 
cuit operation. The importance of doing 
something practical like this is in seeing it 
work and determining why, rather than 
just getting it to work. It is the understand- 
ing of the circuit and the principles behind 
it which are important, rather than the 
practical skills. 

Eleven of these home experiments" have 
been provided in one unit, and sixteen in 
another. They /pically take one or two 
hours to do and in total are allocated up to 
thirty percent of the marks for the unit. 
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Figure 5 : A Design Problem 
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About half the students feel that they took 
too much time to do, but still wanted them 
to be a compulsory part cf th« work. Most 
students expressed some satisfaction with 
the practical familiarity gained with elec- 
tronic components, and with the sheer 
experience of working with circuits. 

Given the philosophy that doing success- 
fully is the major objective, the marking 
procedure becomes (90% of the time) con- 
firming a lot of correct numerical results. 
The use of a computer to mark in this case 
isessential toallo w the experiments tobeas 
extensive as possible. It also allows of 
course detailed feedback comments to be 
made, based for example on specific re- 
sults. 

There are at leer* aspects of electronics 
where the ab ty of the computer to do 
calculations on student^ rccu!L particu- 
larly helpful. 



ncatebt possible way, u\otd»ng crossovers jb much a 




5 6 7 

□ □□□□□□ «~* 

M 12 13 
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1. The performance of electronic devices 
varies greatly from one unit to the next, 
(and from one student to the next due to 
differences in power supply etc). Cor- 
rect operation of the circuit can be deter- 
mined by observing correct irends in 
results rather than absolutely correct 
numbers. 

2. It is useful sometimes to have a "design 
your own" approach. The results can 
vary widely and correct design can be 
determined by analysis of reported 
design values. Figure 5 shows an ex- 
ample of this. 

Because understanding is the goal, ques- 
tions are attached to each experiment 
whichcallforanalysisof the work just done 
at a practical level, and interpretation of 
results. Appendix 5 is an example of such 
a question. 
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Student reaction was sought to the experi- 
ments to determine attitudes about the 
extent to which doing the experiments: 

• helped understand the material in the 
unit 

• increased their interest in the subject 

• were necessary for a good understand- 
ing 

• increased confidence in handling elec- 
tronics. 

Figure 6 shows a distribution of the opin- 
ions offered in each case. 

Simulations. 



Figure 6 : Attitudes to Experiments 
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These are an attempt to overcome some of 
the limitations of the equipment shortage 
at home. They also encourage a "try it and 
see what happens" approach to the practi- 
cal experimentation of the kitchen table. If 
these practical experiments do not work, 
no-one can tell the student why. With the 
simulations, the computer indicates what 
is wrong. 

For the range of circuit types (usingdiodes, 
transistors and operational amplifiers) the 
student can do the following on the screen 
of a study centre computer. 

1. Analyse a selected circuit with values 
provided which do produce a working 
circuit. 

2. Designacircuitbyselectinga particular 
arrangement, and the values of compo- 
nents. Totally incorrect values are pro- 
hibited by the system. A badly-de- 
signed circuit which still works is al- 
lowed to that the analysis will reveal its 
limitations. 

3. Any o f the above circui ts may be al tered 
and again analysed. 

More than half the students trying this 
purely optional exercise lived over 10 km 



Increased 
hectical 
Confidence 



from a study centre, and most used the 
system several times. They felt that the 
exercises did help them to understand the 
circuit*, anJ to become familiar with stan- 
dard values of components. The writers 
personal impressions are that there are 
some people who respond to this kind of 
activity, and some who do not. We will be 
in a better position to assess the value of 
simulations when more students have eas- 
ier access to a computer. 

Impressions 

Presented are some personal observations. 
The effort by staff into these computer- 
based facilities is huge. People involved 
were lecturer, instructional designer, ad- 
ministrator, programmer and production 
staff. Of these, the lecturer is the only one 
who hopes to receive a direct benefit in 
terms of reduced working load. Even so, 
with the typical numbers of students con- 
cerned (70-90) the lecturer would feel the 
need to run the material largely unaltered 
for several years. 
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The major benefit is to the student who has 
many more opportunities for formative 
exercises, receives work back more quickly 
and receives much more detailed com- 
ments on his work. There is someanecdotal 
evidence that more students are spending 
time ringing lecturers directly with specific 
questions about work given. 
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A major problem with CAI systems is the qual- 
ity of their instructional materials. CAI is an 
electronic form of teaching and the normal 
opportunities for teacher observation and feed- 
back are not available. A formative evaluation 
module can be included in a CAI system to help 
to overcome this. It requires little in the way of 
additional programming work to incorporate a 
formative evaluation module into a CAI sys- 
tem Yet CAI authors have been slow to recog- 
nize this potential. The result has been the use of 
multiple-choice questions in CAI which are not 
adequately tested. The author describes a CAI 
system that he has developed which includes a 
formative evaluation module. The system runs 
on an IBM-PC 



Two phases in the evaluation of educa- 
tional material and processes are com- 
monly recognized. These are: formative 
evaluation (i.e. while a CAI system is being 
developed) and; summative evaluations 
(i.e. when the CAI systems is completed). 
Formative evaluation rather than summa- 
tive evaluation is used in the development 
and updating of instructional material. 
The author designed and implemented a 
CAI system which incorporates a forma- 
tive evaluation module. In this paper the 
principles of formative evaluation and its 
application to CAI are discussed. Forma- 
tive evaluation is discussed in the first sec- 
tion of this paper. 

Formative evaluation 

Bloom, Hastings & Midaus (1971), the 
authors of a major work on the evaluation 
of learning and teaching processes, note 
that: 



for the most part the teacher-made 
tests are summarized to show the score 
or marks of individual students. Only 
rarely does the teacher use them as the 
basis for modifying instruction.(p.l 35) 

Student marks are translated into grades 
and used to separate students into the more 
and less able, so that the more able may 
progress to the next stage or to a higher 
stream. However data on student achieve- 
ment has another valuable educational 
application. It can provide the basis for 
improving instruction. Bloom et al. (1971) 
urge educators to use the student-tests as 
the basis of "quality control" of instruction 
andnot:"asitismostfrequently used in the 
existing educational systems ... the grading 
and classification of students'' (Bloom et al. 
1971, p.7). This view of evaluation which 
considers student grading leads educators 
to make decisions about students rather 
than about teaching material and methods. 
Decision making in theeducationalprocess 
must do more than grade students. This 
view is supported by Kandaswamy (1980) 
who contends that it must involve: 

makingdecisionsabout which compo- 
nents of the training material are to be 
modified in order to make the materi- 
als instructionally and motivationally 
stronger, (p.19) 

Frogramme developers determine the ef- 
fectiveness of their material at various 
stages in its creation. During programme 
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development the CAI system is used and 
the responses to the multiple-choice ques- 
tions are recorded. The information could 
be used in a step-wise development of the 
programme. In step one it could be used to 
determine the validity of the test questions 
and in step two, to assess the strengths and 
weaknesses in the preceding instruction. 

The means of providing information to 
students, teachers and the instructional 
designers so as to improve the teaching/ 
learning pi >cess is called 'formative evalu- 
ation'. This term was first used by Scriven 
(1967) in a paper on the methodology of 
evaluation. Bloom et al. (1971) note that: 

it is {Scriven's} view that formative 
evaluation involves the collection of 
appropriate evidence 'during^ the con- 
struction and tryingout of new curricu- 
lum in such a way that revisions to the 
curriculum can be based on this evi- 
dence. (p.117) 

In formative evaluation data on student 
progress and learning is used to determine 
the efficacy of the instructional materials 
and teaching processes. Formative evalu- 
ation is an important tool used in the trial 
implementation of a new programme at 
each stage in its development. Bloom et al. 
(1971 ) note that in the application of forma- 
tive evaluation: 

it may be determined at each step in 
{this} process whether the process is 
effective or not, and if not, what 
changes must be made to ensure its 
effectiveness, (p.8) 

Measuring student progress, such as test 
results, provides information that is used to 
improve the instructional material or proc- 
esses. It involves tests which are as much a 
test of the programme as the /re of the 
student As Weiss (1977) notes: 

formative evaluation produces infor- 
mation that is fed back during the 



development of a curriculum to im- 
prove it. It serves the needs of develop- 
ers. (p.17) 

The information indicates to teachers and 
instructional designers the need to im- 
prove the teaching material or process. 
Areas of weakness, such as lack of under- 
standing or practical ability, are identified. 
A teacher modifies his/her approach while 
a lesson is taking place based on student 
feedback. One of the limitation? with an 
electronic teacher such as CAI is that 
teacher observauon is limited. However 
this can be overcome by incorporating a 
formative evaluation module into a CAI 
system. A CAI formative evaluation mod- 
ule can: 

• assist the initial design and creation 
stages; 

• improve the instructional content; 

• check the logical sequence; 

• help to select questions for CAI drill 
and; 

• improve the communication aspects. 

The improvement of the drill component is 
the first stage in the application of forma- 
tive evaluation to CAI. This aspect of 
improvement of CAI is the subject of this 
paper. In the discussion to follow, the CAI 
system and the functions of the recording 
and formative evaluation modules are 
described. This corresponds with the top 
down design methodology used in the 
construction of the CAI system for this 
project (Price, 1985; Price, 1987). 

The CAI system 

CAI is a method of teaching which uses a 
computer to provide instructional material 
and interacts by asking the student ques- 
tions. CAI tutorials are characterized by 
the use of multiple-choice questions. A 
CAI tutorial instructs the student and asks 
a question on the material ju r t presented. 
For this reason they arc frequently de- 
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scribed as 'instruct and drill' systems 
When students respond they are provided 
with immediate feedback as to whether 
their answer is right or wrong. If they are 
wrong, they may be provided wit K hints as 
to the correct answer, encouragement and 
so forth. The communications between the 
student and the CAI system are controlled 
by the system interface. This interface also 
allows communication with other users, 
such as program authors, teachers, men- 
tors and administrators. All these may at 
some time need to access the CAI system to 
obtain student information or update pro- 
grammes. In the CAI system to be de- 
scribed in this paper there are two types of 
users. These are teachers/ administrators 
and students. The system menu provides a 
route for e ich user to access .he CAI system 
and is illustrated in Figure 1. The CAI 
system controls access to Jata in the CAI 
system by a hierarchy of privilege. This is 
an important consideration because of the 
need to protect the integrity of student 
records and teaching material. 




Create View Menage 
and run progress system 



Run View Message 
lessons progress system 




Figure 1. CAI system menu. 

Typically the teachers' menu allows the 
creation and editing of tutorials and view- 
ing student progress, while students can 
only run tutonalsand view their own prog- 
ress. The ability to provide progress re- 
ports to teachers and students depends on 
theCAl systems recording module. This is 
discussed in the next section. 



The recording module 

Gerhold (1980) found only a small amount 
of interest shown by authors in keeping 
user statistics in more than six years of CAI 
use at the University of Western Washing- 
ton. If records are kept then they should be 
useful, and not just record that a particular 
student has finished a lesson or topic. The 
simplest form of recording system is when 
the number of correct responses is recorded 
against the students name. An example of 
a CAI system which includes a simple re- 
cording module is illustrated in Figure 2. 



(Teacher) 



ITcKheO 




Report 



Select 
and run 



View self- 
progress 



(Student) 



(Student) 



Figure 2. CAI design with a simple record- 
ing system (based on the "progress" data- 
base of McDevitt & Price 1984). 

To implement a formative evaluation 
module the recording module must store 
more than just the on-line information 
provided to students, such as the number 
of correct responses. It is necessary to store 
the student ID and that student's answer to 
each question on the first and second at- 
tempt. The author developed a database 
that held this additional information. It has 
more attributes (fields) than the earlier 
database recording system developed by 
McDevi tt & Price (1984). CAI systems have 
a variety of question types such as mul- 
tiple-choice, true/ false or fill-the-gap. The 
database is sufficiently flexible to cater for 
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most types of question. The author has 
named this new database the "extended" 
database. It stores the student's responses 
to each question on the first and second 
attempt. The teacher/ administrator has 
access to the data and can process it on a 
weekly/ monthly basis with a formative 
evaluation module. The formative evalu- 
ation module is discussed in the para- 
graphs to follow. 

Formative evaluation module 

The writers of multiple-choice questions 
should consult a text such as Thyne (1964) 
for general advice on test construction. 
However Allen & Yen (1979) contend that: 

anyone who develops and uses tests 
should {alsoj be familiar with the pro- 
cedures for test development and 
evaluation, (p.142) 

This does not mean that teachers need to 
understand mathematical statistics. It 
means that they can use statistical meas- 
ures in the selection of multiple-choice 
questions or "items" (as they are called in 
the measurement literature). The forma- 
tive evaluation module of the CAI system 
developed for this project isan item-analy- 
sis program. 

Item-analysis techniques and computer 
programs (e.g. CSHE, 1979) have been 
developed to test multiple-choice ques- 
tions used in examinations and tests where 
students are being assessed (Nedelski, 
1965). In CAI the quality of thedrill compo- 
nent is still important even though stu- 
dents are not being assessed. The tech- 
nique of item-analysis provides informa- 
tion that is used in the formative evaluation 
of the drill component of CAI. An item- 
analysis program identifies questions in a 
CAI system that are ineffective. 

A multiple choice question is ineffective for 
any of the following reasons: 

ERIC 



a. its too (easy) obviousand a high propor- 
tion are correct; 

b. its too (hard) difficult and a high pro- 
portion are incorrect; 

c. both good and poor respondents score 
equally indicating uncertainty and 
probably ambiguity or no exact correct 
response; 

d. negative correlation, suggesting an- 
swer supplied by the item's author 
may actually be wrong and; 

e. if one or more of the distractors attracts 
very few correct responses indicating 
that it is not working and is probably 
implausible. 

An item analysis print-out is illustrated in 
Figure 3 and shows thr items from a 
recent batch of CAI drill. There are two 
important statistics shown in the item 
analysis print-out. These are the item diffi- 
culty and the item biserial correlation. An 
item difficulty close to 1.00 indicates an 
easy question. Conversely an item diffi- 
culty close to zero indicates a very difficult 
question, which few students 'get right'. 
The item biserial correlation gives the cor- 
relation between performance on an item 
(question) and on all other items (ques- 
tions) in the drill. 

Below the author demonstrates the appli- 
cation of item-analysis statistics for the 
three items. Teachers and test-developers 
can successfully use item-analysis without 
needing a full understanding of statistics. 

• Item 1 is too easy. Nearly all the stu- 
dents were correct on this item. How- 
ever there is a good correlation between 
performance on this itemand the rest of 
the drill. 

• Item 6 is a poor question and should be 
modified or dropped. The .48 item diffi- 
culty is quite acceptable. However the 
biserial correlation of .187indicated that 
there is a low correlation between per- 
formance on this question and perform- 
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ance in the remainder of the drill. 

• Item 22 is a good question. Both of the 
level of difficulty and the biserial corre- 
lation statistical measures are satisfac- 
tory. ThL, question should be retained. 

There is a need for at least some easy ques- 
tions in a CAI drill. This is near the begin- 
ning of a lesson where they serve to give 
students confidence. Item 1 is clearly such 
a question. 



Concluding remarks 

Micr< _„ mputers have increased the oppor- 
tunities for the creation of CAI (e.g. Price, in 
press) and improved authoring systems 
have made program creation and modifi- 
cation easier. However as CAI authors 
become more adventurous they need tools 
which will improve the content of their 
material. Formative evaluation is one such 
tool. 



Figure 3: Item analysis of three multiple-choice question. 
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The effectiveness of an educational package 
generated by use of any authoring system 
depends on the methodical development of 
the instruction al design. There are number of 
stages involved in a complete instructional 
design. One is the development of the de- 
tailed instructional material as a series of in- 
structional events to be presented as a se- 
quence of frames. The most common ap- 
proach for a systematic development of this 
material is to prepare the detailed layout of 
each frame on paper. These layouts are tra- 
ditionally referred as storyboards. The data 
entered via electronically prepared story- 
boards has been used [81 , to author lessons 
using the WISE authoring system. Extending 
this idea, this paper surveys its application to 
other authoring systems and suggests that 
storyboards can be generalised as a distinct 
data type to be processed electronically on a 
wider environment, and so provide a general 
tool for effective instructional design. The 
development of such tools offers promise of 
efficiency in the authoring cycle, and further 
author support through electronically acces- 
sible high-level documentation. 

Systematic development of instructional 
design is the most important part of pro- 
ducing Computer Based Instruction (CBI) 
material. Basic development stages of an 
instructional design system for any com- 
puter based courseware can be summa- 
rised as follows: 

1. Identify the objectives of the subject 
matter to be taught according to the 
target population with the help of ex- 
perts 

2, Establish the hierarchy of topics to be 
presented according to the set objec- 

a tives 
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3. Prepare the detailed layout of the in- 
structional materials on paper accord- 
ing to the sequence in which the subject 
matter is to be presented 

4. Prepare the material for presentation 
usingan authoring system. (Romiszow- 
ski, 1986). 

There are a number of steps involved in the 
development cycle (Romiszowski, 1986; 
Bork, 1984) for each of these stages, and it is 
important that each step be reviewed for 
x the effective production of the educational 
package. 

It is possible with a number of authoring 
systems, for the instructional designer to 
document the objectives and the topics of 
the subject maUer electronically. Systems 
such as PCD3 (Plato's courseware design 
system fcr PC'S) and Course of Action 
(courseware design system for the 
Macintosh™ personal computer) allow the 
author to build a logic map of each section 
of the lesson, thus providing a very useful 
authoring tool. The third stage of the in- 
structional design very much depends on 
the authoring system being used. Most 
experienced instructional designers, au- 
thors, and authoring system developers 
suggest the storyboard approach to pr 
pare the detailed layout on paper for e n 
frame or event according to the sequence in 
which it is to be presented. The layout of 
these storyboard forms depends upon the 
authoring system (reference note 1). Hav- 
ing prepared these storyboard forms, it 
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would be ideal if the majority of the infor- 
mation entry could be passed on to a typist 
for straight forward data entry. Since most 
of the authoring system requires a certain 
level of expertise in using the software, it is 
not easy for a novice user to enter the data. 

We have discussed in a previous paper 
(Quaine & Sampath, 1986) how the data 
entered via electronically prepared story- 
board forms has been used to author les- 
sons using the WISE authoring system. The 
aim of this presentation is to extend this 
idea to other authoring systems and sug- 
gest a unique storyboard form that can be 
adapted io any authoring system. This will 
provide a general authoring tool for effec- 
tive instructional design and offers prom- 
ise of further efficiency in the authoring 
cycle. 

Authoring efficiency vs Authoring 
tools 

The quality of CBI material depends on a 
variety of factors. However, as mentioned 
by Anver et a/ (1984), the three major factors 
contributing to the quality of production 
are: 

1. Experience with instructional design 

2. Experience with authoring software 

3. Experience with subject matter. 

Of thesefactors they have shown that expe- 
rience with authoring software provides 
the most cost effective method of improv- 
ing authoring productivity. This finding 
concurs with the survey done by Lommel 
(1986). However, the provision of tools like 
automated storyboards as an additional 
authoring aid can reduce trie need for ex- 
pertise in using authoring softvare. Table 
1 shows the results of our survey of differ- 
ent authoring systems, the authoring time 
required to prepare one hour of course- 
ware after the design and analysis of the 
instruction materials. 



It is clear from the table that development 
time of the CB. courseware is highly vari- 
able and depends on the complexity of the 
course being developed. The courseware 
prepared by AIP and Telecom involved 
more complexity than those prepared by 
Expert Solutions. However, the time 
quo ted by Telecom seems high . The f olio w- 
ingreasons could be contributing factors to 
the magnitude of the time required. 

1. Setting up the screens with responses 
and feedback is quite a difficult task 
using WISE. To obtain the required 
effect, the free response frames must be 
combined appropriately with calcula- 
tion frames. 

2. Setting up calculation frames in WISE 
requires special programming lan- 
guage skills, similar to those required 
for programming in Pascal. 

3. The user design did not specify the 
preparation of detailed layout of the 
frames on storyboard. 

The authoring time in this case could be 
considerably reduced if the front end soft- 
ware tools developed for WISE (Quaine & 
Sampath, 1986) had been used. AIP authors 
quoted that, in the complete development 
cycle of the courseware, starting from 
design and analysis, 20% of the develop- 
ment time is spent on creating relevant 
graphic images. The level of complexity of 
the courseware pr ?d by Expert Solu- 
tion using PCD3 and WISE was compa- 
wVit. However, the authoring time using 
I ^D3 is almost 30% less than using WISE. 
Probably the availability of additional tools 
in the content and strategy editors of 
PCD3, could be the reason for the reduced 
authoring time. Macleod (1983) states that 
the total development time varies irom 
100-300 hours (60-180 hour* for preparing 
script and 40-120 hours of programming) 
for test only courseware to simulation type. 
An entire semester's chemistry course was 
developed at the university of Delware 
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AUTHORING 
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COURSE 
NAME 


AUTHORING 
TIME 
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TOTAL 
DESIGN 
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of 
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Story board 
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PC CLASS 


Dept of 
Army 


Electronics 
Training 


100 


240 


Story board 


CourseMaster 
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Melbourne 


The 

Electricity 
Project 


200 


500 


Storyboard 


WISE 


Telecom 
CBT branch 
Melbourne 


Form 
Filling 


400 


NA 


None 



Table 1. 



(Garton et al, 1984). They quote a total 
development time of 350 hours (105 hours 
for scripting, 195 hours programming and 
50 hours of testing) for an half hour lesson. 
These results indicate that any additional 
software used as an authoring aid can pro- 
duce cost effectiveness. From this survey 
we do feel that a genera 1 purpose story- 
board form can be a distinct data type, that 
can be introduced for preparation of CBI 
materials, and processed electronically in 
thedevelopment of the overall pedagogical 
design of instructional material. 

General purpose storyboard forms 

The storyboard forms used in o^r previous 
paper (Quaine & Sampath, 198b) were 
specifically designed for WISE authoring 
system. Those forms cannot be directly 
used for ou jr systems because of dissimi- 
laritiesat the user intp^ce. Neither do they 
use f lie frar^c name as the basic building 
Wock. Dome do use named screens, or 
pages, which are similar to frames. There is 



a new breed of authoring systems that use 
events as building blocks, and each frame 
can be considered to eon^st of number of 
events or may be a single event. Merrill 
(1987) argues that the frame is a passive 
concept, and proposes a new terminology 
called an instructional transaction, and 
claims that a transaction is an active con- 
cept. However, the concept of the frame 
was earlier thought to be the correct model 
(Merrill, 1985). The concept of the presen- 
tation screen is clearly the unit of interest to 
the student, but from the author's point of 
view the display details could be a collec- 
tion of frames, screens, pages or events. 
However, the key issue is that the material 
needs to be prepared and documented in 
the form of a storyboard. Table 2 shows the 
basic unit of current authoring systems. 

All these systems provide the facility to set 
up different types of testing using the ques- 
tion styles like single or multiple word, free 
response, true/false, match the list, and 
multiple choice. The systems Author and 
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CourscMaster allow the author to set up 
mathematical question types. 

This summarj is supported by Data 
Training's (1986) Annual Survey of CBT 
authoring systems, which suggests that the 
basic building blocks of the instructional 
material can be classified into three types : 

1. Menu type. Allows the s, ident to select 
a particular section of the lesson. 

2. Presentation type. One that does not 
require any response from the student. 
Qite$tion&>amzve'hjpc. Ac cording to the 
student's response a particular action is 
taken. 

The question & answer types can be any of 
Ihe following types: 

1. Single word response 



2. True or False response 

3. Multiple choice response 

4. Tree text response 

5. Give response^ by matching a list . 

Other common features ol these authoring 
systems are that they allow the author to 
give feedback for the student's responses 
and to nave complete control of the 
student's progress through the lesson. So it 
is not difficult to extend the id. a of process- 
ing the storvboards electronically, which 
we us \1 for WISE authoring svstem. The 
storyboard processing of this svstem con- 
sisted of three processes: 

1 . Createsbs — to create storyboards. 

2. Lessonoverview — to produce data 
flow of lesson logic 

3. Printsbs — prints the detailed layout of 
stoi /boards. 
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Figure 1 : Storyboard part 1 



The only process that has to bo changed to 
make this system adaptable to other sys- 
tems is ihe Createsbs, In order to include 
the different features oifered by the other 
systems. Three levels oi menu selections 
could be allowed in this process. The first 
level will dc to establish whether the au- 
thoring system to be u^ed is frame based or 
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event based. The second level of menu se- 
lection will be to choose one of three basic 
types we have mentioned earlier i.e menu, 
presentation, question & answer types or 
any other type (other type could be special 
options provided by other systems). If the 
user chooses the question & answer typ^ 
then it will display the third level of the 



n 



Using Computers Intelligently 



363 



FrName: First 
Welcome to lesson 



Fr Name : Second 
Summary of the lesson 



Fr Name : Presl 
Objectives of the lesson 



Fr Name : Pres2 
Summary of each item in the lesson 



Fr Name : Menul 
Student is allowed to select one item out of 4 



FrName: Pres3 
Definition of 
Quadralaterals 



FrName :Q1T/F 
Testing Student's 

Knowledge 
on Quadralaterals 



Menul 



1 



Menul 



Pres3 



Fr Name : Pres4 
Summary of 
Geometrical shapes 



Fr Name :Q2multi1 
Testing Student's 
Knowledge on shapes 



FrName: End 
Guidance to continue 



Menu 1 



Pres4 



Figure 2: Logic flow of a lesson 

menu which will allow the user to choose 
the type of question he wants to create. 
Figure 1 shows part 1 of the modified story- 
board form for a presentation frame and 
one word answer and question type ( for 
event type of authoring system the word 
frame will be replaced by event). Similarly 
other storyboard forms could be designed 
for other frame or event types. 

The field Brief Desc in part 1 of the story- 
board form is to allow the user to enter 
brief description of what is to be displayed 
in the frame. This description will be 
printed for each frame when the process 
Lcssonoverview is run. 

The output of Createsbs can be input to 
Lesson overview to produce the layout of 
the lesson as shown in Figure 2. 



Except in the case of PCD3 authoring sys- 
tem, all the other systems provide the 
facility to create a set of graphic libraries 
and those can be called in any lesson. Most 
of these systems can indicate the exact loca- 
tion of the cursor and thus any graphic 
object from any library canbe positioned at 
that coordinate on the display frame. AIF 
employs special graphic designers to create 
the graphic libraries required for the 
courseware. The CourscMaster authoring 
system provides some of the facilities of the 
storyboard processing we have developed 
for WISE. Their system can also produce 
the hard copy of the flow of Wesson details in 
the textual format. This electronically 
accessible documentation is within the 
authoring sys,tem. The method of story- 
board processing that is being suggested in 
this paper is independent of any uu thoring 
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SBNO : 1 LESSON NAME : JXAMPLE 

FRAME NAME : FIRST 



TEXT TO BE ENTERED 



FRAME TYPE : PRESENTATION 



(X.Y) 



POSITIC 



GRAPHIC OBJECTS 



LIBRARY USED 



POSITION (X,Y) 



TO ENTER MORE TEXT OR GRAPHIC OBJECTS PRESS — ^ 



SBNO 2 



LESSON NAME EXAMPLE 
FRAME NAME SECOND 



FRAME TYPE . QUESTION & ANSW 
QUESTION TYPE ■ One Word 



ENTER TEXT TO BE DISPLAYED: 



TEXT SIZE 



GRAPHIC OBJ' ,rS 



LIBRARY USED 



POSITION (X,Y) 



FEEDBACK' 



TO ENTER MORE TEXT OR GRAPHIC OBJECTS PRESS 



Figure 3: Storyboard part 2 



sy st cm a nd ca n be u scd a 5 f ro n t en d tool for 
any system. The ideal situation in a large 
production environment would be to pre- 
pare the necessary graphic images by the 
graphic designers as done by AIP, and 
enter the sequenceof lesson details via part 
2of th? ^ry board form, shown in Figure3. 



This type of approach will provide excel- 
lent documentation in the development 
cycle and smooth running of the whole 
project. As well said by Palmondon and 
De^chenes (1986), consistent documenta- 
tion cannot be kept during the develop- 
ment cycle of a courseware without auto- 
mation of the most mundane task of edit- 
ing. 
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Lesson Preparation 

In the case of WISE lessons, keystroke files 
for the lessons could be generated by the 
preprocessors using ihe data entered in the 
storyboard forms. Using the input stream 
redirection facilities (WICAT, 1983) of 
WMCS, these keystroke files are input to 
WISE to generate the lessons automati- 
cally. Similar preprocessors can be written 
for the authoring systems like AUTHOR 
and FSL , an authoring language under 
development (Quaine & Johnson, 1986), 
and data entered in the storyboard forms 
can provide the variable input to these 
authoring languages. It could be investi- 
gated whether the keystrokes for creating 
each frame or event type could be captured 
using the operating system facilities of 
other authoring systems. If it is viable, then 
preprocessors can be developed similar to 
the user interface tools for WISE. Whether 
the preprocessors are essential or not de- 
pendson the users of a particular authoring 
system. Even if the preprocessors are not 
available it will be easy to transfer instruc- 
tional material from well documented sto- 
ryboards 

Discussion 

Most of the authoring systems aim at pre- 
paring similar type of instructional materi- 
als. Thus providing the automation of 
storyboards as an authoring aid to these 
systems can standardise the production of 
CBI material. This need not be considered 
as a front end tool only for the authoring 
systems. This can also be used as a front 
tool for developing audiovisual instruc- 
tional materials similar to the IBM's Story- 
board software package (Robbins, 1986). 
Our survey of different suthoring systems 
does indicate that storyboards can be gen- 
eralised as a distinct data type to be proc- 
essed electronically on c wider environ- 
ment, and so provide a general tool for 
effective instructional design. The devel- 
opment of such tools offers promise of eff i- 
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ciency in the authoring cycle, and further 
author support through electronically ac- 
cessible high-level documentation. Such 
documentation can be ported to other sites 
of development and with slight modifica- 
tion to the material it could even be adapted 
to another system. As suggested by Bork 
(1984) this documentation can be sent to 
reviewers and expeiis which will enable 
the material to be reviewed before it is 
collated in to a courseware using an au thor- 
ing system. With most of the authoring 
systems it is tedious to modify the linkage 
between the frames once a *ai ge number 
frames have been produed. In the story- 
board board processing the links set up can 
be easily modified and reviewed thor- 
oughly before it becomes CBI courseware. 
This labour intensive process of instruc- 
tional design and development can be 
made more cost effective by further devel- 
opment of Automated Instructional Sys- 
tems similar to the Courseware Instruc- 
tional Toolkit developed by Courseware 
Inc Kearsley, 1986. (This is a prototype 
system and the current version runs on 
IBM PC/XT.) A number of organisations 
are moving towards using CBI for training 
purposes. These types of automated sup- 
port tools can provide a consistent metnod- 
ology , re-usable design and cost-effective 
computer based teaching programs in a 
training environment (Howes & Williams, 
1986). 
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Computer Managed Learning - its application 

to increase student achievement using formative 
self-assessment 



Jon D. Stanford, University of Queensland 

Howard P. Cook, Queensland Institute of Technology. 



Computer based assessment was introduced 
into an introductory economics subject, ECHO, 
in the Department of Economics, University of 
Queensland, during Second Semester 1986. 
Over 600 students used computer generated and 
marked random tests for a number of assign- 
ments. 

A commercial Computer Managed Learning 
(CML) software package was used to issue and 
mark student tests and to keep records, generate 
reports and analysis of student and question 
bank performance. Because tests were answered 
by students away from the computer, only a 
small number of terminals were required The 
distinction is made between Computer Man- 
aged Learning and Computer Assisted Learning 
(CAI). 

The effectiveness ox the CML system is evaluated 
by using evidence from the responses to a Stu- 
dent Questionnaire and by the end-of-year ex- 
amination. 

The paper concludes that CML provides a pow- 
erful mechanism for add'^sing such issues as 
learning effectiveness, v zation of resources, 
student motivation, support to students, learner 
control and cost-effectiveness. 

It is recommended that tertiary institutions give 
serious consideration to the implementation of 
CML on a wide scale in order to improve student 
performance and staff productivity. This can be 
done at affordable cost. 



This paper ^escribes the implementation of 
CML in a large first-year economics course 
at the University of Queensland in Second 
Semester 1986. Although the introduction 
of CML arose from a particular set of cir- 
cumstances and although CML was ini- 
tially thought of as a trial run for 1987, CML 
was very effective and even in its first-up 
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format was successful in promoting stu- 
dent learning. The introduction of CML in 
1986 led to much more widespread adop- 
tion in the Department of Economics in 
1987. 

The particular circumstances occurred 
because one of the authors, Jon Stanford, 
had returned to lecturing the first- year 
course in 1985 and was interested in im- 
proving student performance and student 
motivation; as well he had a strong back- 
ground in instructional design, use of 
computer simulations, and use of various 
media and course evaluation at the Univer- 
sity level. The othc r author, Howard Cook, 
on secondment to the Computer Assisted 
Learning (CAL) Unit, University of 
Queensland, to advise university staff on 
the application of CML had a strong back- 
ground in applications of CML for indus- 
trial training. Co-incidently the Faculty of 
Commerce and Economics, University of 
Queensland, had just installed a VAX 
computer which v/as available for use. The 
CAL Unit had purchased a commercial 
CML software package (CBTS) which oper- 
ates on the VAX range of computers. Thus 
all the ingredients required for CML imple- 
mentation, hardware, software, systems 
support, instructional design and over 600 
students were available. The implementa- 
tion worked well because the authors were 
able to work co-operatively and to enlist 
support from many sources. 

The problems of organising, teaching and 
managing a large first-year course are sub- 
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stantial. Most students in the course enter 
university direct from school and many 
find the transition difficult. Many students 
find sitting in large lecture theatres alienat- 
ing and in such an impersonal environ- 
ment lose motivation. Academics are gen- 
erally swamped by day-to-day concerns of 
administration of a large course: making 
sure student handouts are ready on time, 
dealing with student enquiries, liaising 
with tutors, setting tests and examination 
papers, maintaining records of student 
performance and progress, Ihey are unable 
to take a detached look at the course and 
what they should be doing, and are unable 
to plan rationally for course development 
and for course innovation. Australian uni- 
versities have been under financial pres- 
sure for some years and are unable to de- 
vote increased resources to overcome these 
problems. 

The solution to some of these problems lies 
in the adoption of a new approach which 
will encourage students to take greater 
responsibility for their own learning, to set 
andachieve thekown learning goals and to 
acquire good learning skills which will 
stand them in good stead during their 
professional lives. Consequently the im- 
plementation of a CML system within a 
large course is more than the use cf a com- 
puter in teaching; it necessarily embodies 
the adoption of a different approach to 
learning and teaching in which the role or 
the teacher is that of facilitator of learning 
and manager of learning experiences. As 
Jon Stanford often remarks "the first thing 
to learn about computer managed learning 
is that it has very little to do with comput- 
ers/' 

Definition of CML 

Computer Managed Learning is defined 
here as the application where the computer 
does not have an instructional role and 
where the function of the computer is in the 
control, administration and testing of the 



learning process. Management of learning 
is the process of coun* design, specifica- 
tion of learning objectives, issue and mark- 
ing of tests, recording results of tests, pro- 
vision of feedback and remedial support, 
analysis of mo*, .ule effectiveness, analysis 
of learning performance, preparation of 
reports to students and lecturers (Miller 
1986). 

There is an important distinction between 
Computer Managed Learning and Com- 
puter Assisted Instruction. Computer As- 
sisted Instruction is taken as the learning 
process in which instructional material is 
stored in the computer and released to a 
student seated at a computer terminal. 
Computer Managed Learning is used to 
refer to the system where instructional 
material is available only externally to the 
computer and where the computer plays 
an important management function. It is 
possible for a CML system to incorporate 
Computer Assisted Instruction but it is 
generally not necessary or even desirable. 

The Course 

The course, ECHO Introductory Econom- 
ics, is a standard principles course which 
accounts for 25 per cent of the workload of 
a full-time student. The course is designed 
for continuing students in economics; the 
Department offers as well a terminal first 
year course for students who do not intend 
to proceed to the study of economics at 
second-year level. 

The course, ECHO Introductory Econom- 
ics, is required for all students enrolled in 
the Facu ty of Commerce and Economics 
(unlike most ether Australian universities 
both the B Com and B E^. n degrees are 
offered by the University of Queensland) 
and is available to students in other Facul- 
ties, especially Arts, who wish to enrol for 
a nonterminal course in economics. Total 
nominal enrolment in 1986 was 640. 

The major featuresof the course enrolment 
^can be summarised as follows: 
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• approximately 50 per cent of students 
are enrolled for the B Com degree; 

• approximately 25 per cent of students 
are enrolled for the B Econ degree; 

• approximately 25 per cent of students 
are enrolled for the B A degree or an- 
other degre?; 

• he entry requirements for the B Com 
degree are significantly more stringent 
than for the other degrees; 

• approximately 75 per cent of students 
have entered direct from Queensland 
Grade 12; 

• a small but significant proportion of 
students have experience of successful 
tertiary study. 

The course is taught by large lecture format 
to three self-selected groups, two of which 
are scheduled during the day and the other 
scheduled in a block in the evening. The 
course is taught throughout the year i.e. 
over the two semesters, and is examined by 
two formal unseen examinations, each of 
two hours duration, in November. 

The lectures are given by three academics; 
one of whom teaches the First Semester and 
the other two each teach half of Second 
Semester. The end-of-year examination is 
divided into three parts to reflect this divi- 
sion of lecturing effort. 

The final grade for the course is determined 
by a combination of progressive assess- 
ment and end-of-year examination with a 
relatively high weighting towards the end- 
of-year examination. Although the deter- 
mination of the final grade is relatively 
complex it can be conveniently explained 
in Table 1. 

Table 1. Contribution of Each Form of Assessment to 
the Final Grade in ECHO in 1986. 



Form of Assessment 



First Sim ester: 
Best Five Class Quiz Marks 
Two Assignments 
End-of-Year Examination 



Number of 
Marks 



Second Semester: 

Best Five Class Quiz Marks 25 
(Part A & Part B) 

Assignment - Part A 5 

Assignment - CML Test 5 

End -of- Year Examination - Part A 30 

End-of-Year Examination - Part B 35* 

* This mark was scaled according to the student 
performance m the final two CML tests. 

The procedure is illustrated in Table 2 on 
the assumption that the maximum marks 
on the CML tests had been obtained: 

Table 2: Illustration of Scaling of End-of-Year Exami- 
nation Marks, Part B, ECHO, 1986. 



Unadjusted Mark 
Ot of 



Scaled Mark CML 

Scaled Mark 
out of 25 out of S5 



35 i larks 


% 


Mark 






35 


100 


25 


10 


35 


100 


30 


86 


21 


10 


31 


89 


26 


75 


19 


10 


29 


83 


25 


71 


18 


10 


28 


80 


23 


65 


16 


10 


26 


74 


20 


57 


14 


10 


24 


69 


18 


50 


16 


10 


23 


66 


15 


43 


11 


10 


21 


60 


10 


29 


7 


10 


17 


49 



25 
10 
65 



The first CML test was in lieu of an assign- 
ment; the other two were voluntary; marks 
were obtained on an "all or nothing" basis. 
During 1986 there were no small group 
tutorials available in the course; students 
were required to complete a weekly class 
quiz and the results of this quiz were dis- 
cussed in a "mass tutorial" following a 
lecture. 

Learning Objectives for the Course 

Previous experience with students in 
ECHO (and with later year economics stu- 
dents) has indicated that, in general, stu- 
dents could perform at high levels in tests 
involving verbal recall but that in tests 
requiring the display of other skills they 
performed at significantly lower levels. 

Are*s where students have performed at 
low levels are: 
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a. identifying the empirical counterpart of 
concepts understood in verbal terms; 

b. drawing logical inferences from verbal 
statements or from simple data (either 
hypothetical or real); 

c. drawing strong conclusions from ver- 
bal statements or from empirical data; 

d. performing relatively simple calcula- 
tions; 

e. developing detailed critical analysis of 
theoretical or empirical topics. 

Testing through the CML system was de- 
signed to improve student performance in 
areas a, b, c and d above and it was recog- 
nised that other responses were required to 
improve student performance in area e; in 
this area students have to acquire skills 
which involve analysis, selection, discrimi- 
nation, synthesis, criticism and evaluation. 

Thif : .mplies the use of a two tier approach 
to learning in which the competence prin- 
ciple was adopted for the first tier where 
basic level skills are acquired. This ap- 
proach was seen as appropriate in the 
course, ECHO Introductory Economics, 
where competence in basic level skills 
comprises the great majority of student 
effort. The competence approach required 
the division of course material into rela- 
tively self-contained modules and the pro- 
viding students with clear cut learning 
objectives and specific instructions as to 
how to achieve those objectives. An inabil- 
ity to achieve these objectives at high levels 
(i.e competence) at the first attempt was not 
regarded as "failure"; instead learners are 
"recycled" until they attain competence. 
This implies that learners may proceed at 
their own pace in achieving learning objec- 
tives although institutional and logistical 
constraints place limitations on self-pac- 
ing. 

The achievement of learning objectives at 
the first tier provide the ground work for 
acquisition of skills at the second tier level 
but the tasks set for learners to acquire 



second tier skills should not involve repeti- 
tion of tasks used in mastery of first tier 
skills but should be designed more explic- 
itly to achieve the particular learning objec- 
tives of the second tier. 

This design of the course uses principles of 
learning derived horr\ the Keller Plan ap- 
proach to learning and from the general 
principles of a Personalised System of In- 
struction. 

Contribution of the CML System to Achieving 
Learning Objectives 

A CML system is able to make a significant 
contribution to assisting students to 
achieve the learning objectives of the 
course in the following ways, by: 

generating unique tests for each stu- 
dent 

marking the tests immediately 
allowing the lecturer to monitor indi- 
vidual student 
progress through the course 
recording student marks and other 
data 

providing various reports 
providing detailed statistical analysis 
of student performance 
generating detailed statistical analysis 
of the answers to items in the test bank 
so that testing procedures can be 
modified in the light of experience and 
of revealed difficulty. 

A CML system offers significant advan- 
tages in that computers have a distinct 
advantage over people in doing repetitive 
tasks, in recording data and in undertaking 
large calculations and in collating informa- 
tion. 

The testbank consisted of the following 
style of questions: 

true/false 
multiple choice 
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matching 

completion 

calculations. 

Some typical questions and their relation- 
ship to the learning objectives are given: 

Matching Question: 

"Consider the following statements: 

1. Exports of coal from Australia to 
Japan; 

2. Import of an IBM computer to Aus- 
tralia; 

3. Payment of interest on an overseas 
loan owed by the private sector in 
Australia; 

4. Payment of an age pension to an 
Australian citizen living in Greece; 

5. Purchase of an airline ticket by a 
resident of Hong Kong from Qantas 
for travel from Hong Kong to Sin- 
gapore; 

6. Purchase of oil by a Liberian regis- 
tered ship in an Australian port; 

which category would these be clas- 
sified as, namely (G) goods, (S) serv- 
ices, (I) income, (T) transfers. (Enter 
your answer as either G, S, I or T. 
Note: Some categories may not ap- 
pear, others may appear more than 
once.)" 

This question is related to learning objec- 
tive a; i.e. "identifying the empirical 
counterpart of concepts understood in 
verbal terms." 

True/False Question: 

"Given the following hypothetical data 
on exchange rates in respect of the Aus- 
tralian foreign exchange market: 



Yen/$A 
June 1935 310 
'une 1986 270 



Brazilian Cruzcno/SA 

3560 

4920 



The Japanese yen has dr 
against the $A?" 



stated 
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This question relates to learning objective 
b. i.e. "drawing logical inferences from 
verbal statements or from simple data (ei- 
ther hypothetical or real)." 

Calculation Question: 

"Assume you are a portfolio manager with 
$A ### to place in the short term money 
market and that the spot Dutch Guilder/ 
$A rate is #.## and that money market rates 
in Amsterdam and Brisbane are ##% and 
##% p.a. respectively for a six month term; 
what six month forward exchange rate 
would leave you indifferent between plac- 
ing funds in Amsterdam or Brisbane? 
(Express your answer to two decimal 
places e.g. X.XX)" 

[Note: The numbers represented by ### 
are randomised variables so that each cal- 
culation is unique.] 

This question illustrates the proposition 
known in economics as " the covered inter- 
est parity theory of foreign exchange" and 
is important for understanding the rela- 
tionship between money markets and tor- 
eign exchange markets. The calculation is 
fundamenta' to understanding the con- 
cepts involved. 

Implementation of the Project 

The project used a VAX cc ~nputer and the 
software supplied commercially by CBTS 
with a testbank specially written by Jon 
Stanford. The course material was divided 
into three modules: 

• International Trade and the Balance of 
Payments 

• Foreign Exchange 

38 1 
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• The Monetary System and Monetary 
Policy. 

A further subdivision of the modules may 
have been desirable but the limitations of 
the time available for the project (the final 
seven weeks of Second Semester) and the 
large number of students made this im- 
practicable. 

Students were required to take three ran- 
domly generated tests; one for each mod- 
ule. Each test consisted of approximately 15 
questions being a mixture of true/false; 
multiple choice; matching and calculation 
wi th each type of question carrying a differ- 
ent weighting. The mastery level was set as 
75% for the first test, 80% for the second test 
and 8*% for the third test. Students were 
allowed «, maximum of three attempts at 
each test; e^ch test had different randomly 
drawn questions. 

Student names and identifiers (the first six 
digits of their student number) were 
loaded onto the VAX from student master 
files held on the University's IBM main- 
frame avoiding the need to enter such data 
manually. 

On a terminal students were able to: 

• draw a test 

• have test marked 

• examine the learning objectives 

• set/change a password 

• send a message to the lecturer 

• look at their records and status. 

If students drew a test the computer gener- 
ated one which was then queued for print- 
ing at one of the two teletype printers and 
logged the student off the system. If stu- 
dents took one of the other options they 
remained on the system for longer but for a 
relatively short period. 

The system had 14 VDU terminals and this 
proved to be generally satisfactory for the 



600 students who used the system; there 
were queues at peak times especially lunch 
time but these were no longer, and nearly 
always shorter, than those in the student 
Refectory. The Computer Room was open 
8am-10pm, Monday to Friday and 9am- 
5pm Saturday and Sunday. 

Students prepared answers for the test 
away from the computer; some answers 
required consultation with the te>* bookb, 
lecture notes, handouts and required calcu- 
lations to be performed. When ready to 
answer the test students logged on to the 
system and gave their answers when 
prompted by the computer which pro- 
vided opportunities to review and change 
answers. When the answering process was 
completed the computer marked the test, 
informed the student of the percentage 
achieved and printed out the correct an- 
swers to incorrectly answered questions. If 
students obtained the required percentage 
they were able to draw the next test; if not, 
they could draw another test cn the same 
module. 

The lecturer was able to monitor student 
progress from reports supplied on demand 
by the CML system, to respond to individ- 
ual messages from students and to give 
messages to the entire class. 



Discussion of Student Qu 



rztimnaire 



Details of the Student Questionnaire are 
available in a detailed report of the project; 
some issues raised by students which re- 
quire further elaboration are discussed 
here. These are: 

• system problems 

• test design and construction problems 

• cheating 

• formative versus summative testing. 

ITie second surprise from the project (the 
first being the extremely high level of stu- 
dent support for CML) was the relative 
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small number of system problems. Most 
related to printer and paper supply prob- 
lems; given the demands on the printers 
(over 3500 tests and 3500 results were 
printed in six weeks) and the poor quality 
printers used, the problems were well 
within acceptable bounds however annoy- 
ing and frustrating they were to the stu- 
dents concerned. The solution to this prob- 
lem is simple - buy better quality printers! 
(This has been done at low cost in 1987 and 
this area of difficulty has been significantly 
reduced). 

The level of problems with the test design 
and construction was also low; some prob- 
lems were easily fixed - errors in questions 
and solutions were eliminated as soon as 
they became known and some test items 
were refined in the light of immediate 
experience; however, the temptation to 
tinker with the testbank was resisted until 
the CML testbank analysis had sufficient 
data. 

Some students commented that questions 
were "ambiguous"; this may have been 
true of some questions but most of the 
"ambiguous" questions showed that some 
students were unable to discriminate be- 
tween finer shades of meaning, closely re- 
lated concepts and valid and invalid infer- 
ences. 

A small number of comments related to the 
possibility of "cheating" because tfv tests 
were done away from the terminal without 
supervision. Since the testing was designed 
as formative rather than as summative, 
students were encouraged (at times re- 
quired) to consult , textbooks, notes and 
references to answer test questions cor- 
rectly. As well, some test items generated 
spirited (at times heated) debate in srna) 1 
groups of students. We think that such 
activity is entirely appropriate at a univer- 
sity and consider that it is a desirable fea- 
ture of the CML system if i* encouraged 
such behaviour. 
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It is possible under the testing procedures 
for a student to cheat in the ordinary sense 
of the term i.e. to obtain answers from 
another student and use them for their 
own. However, the system has safeguards 
against this. 

First, each test is unique (calculation ques- 
tions have been randomised so that even if 
two students receive the same question the 
numbers are different) so that collabora 
tion is made difficult. This is particularly 
true in the first year of CML when all the 
questions are new and the/e is a high level 
of uncertainty about the correct answer. 

Secondly, while there are advantages to 
cooperation between students, it remains 
true to say that students are in fact compet- 
ing for grades so there is an incentive for 
better students to withhold information. 

Thirdly, tu cheat in this way requires the 
cheater to be able to identify other students 
with superior and correct information and 
who are willing to release this knowledge; 
empirically we can say that such abilities to 
discriminate are rare. 

Fourthly, and perhaps more importantly, it 
should be understood that the CML system 
and associated computer held records pro- 
vide an easy ineans for the lecturer to main- 
tain surveillance of student performance 
and to identify students whose perform- 
ance on the CML tests appears to be incon- 
sistent with other test results and student 
characteristics. 

Fifthly, assessment of the end-of-year re- 
sults suggest that very few students passed 
the course by cheating in the CML tests. 
This issue is being examining closely in the 
study of student performance now being 
undertaken. 

The student questionnaire 

QUESTION 1: Before using the CML sys- 
tem did you have any previous 
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experience with computers? 

QUESTION 2: What did you think about 
computer based (immediately 
available) testing? 

QUESTION 3: What did you think was the 
greatest advantage of the CML 
system? 

QUESTION 4: Did you experience any 
frustrations with the CML sys- 
tem ? 

QUESTION 5: Would you have liked the 
CML system in the entire ECHO 
course? 

QUESTION 6: Would you like to see the 
CML system in other courses? 

QUESTION 7: Do you have any other 
co mments abou t yo ur experience 
with the CML system? 

QUESTION 8: What is your verdict on the 
CM L system? Shou Id the Depart- 
ment proceed with this system? 

QUESTION 9: Would yo u like to have more 
control over the CML system 
(e.g. drawing tests whenever you 
liked; proceeding through the 
course as fast as you liked)? 

QUESTION 10: Would you please tell me 
something about yourself? 

QUESTION 11: Any other comments? 

Evaluation of CML 

The evaluation of CML was earned out by 
assessment of the responses to the Student 
Questionnaire, the results of the End-of- 
Year Examination and the cost of CML. 

The responses to the Student Questionnaire 

The response to the Student Questionnaire 
was over 75 per cent of the nominal student 
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enrolment and comprised the following by 
degree enrolment: 

Per Cent 
B Econ (incl. B Econ/LLB) 20 
B Com (incl. B Com/ L LB) 53 
B A and other degrees 28 

This is representative of the total enrol- 
ment. 

In answer to Question 5: "Would you like 
to see the CML system in the entire ECHO 
course?" 91 per cent of respondents said 
y^ in answer to Question 6: // Wouldyou 
like to see the CML system in other 
courses?" 87 per cent of respondents said 
yes; while in answer to Question 8: "What 
is your verdict on the CML system? Should 
the Department proceed with this sys- 
tem?" 96 per cent of respondents said yes. 

From this evidence we conclude that the 
student satisfaction with the CML system 
was at a high level and that student re- 
sponse to the system was positive. 

from the general discussion oi the re- 
sponses to the Student Questionnaire we 
conclude that generally the CML system 
constituted a positive learning experience 
for most students. 

The results of the End-of-Year Examination 

The unadjusted and unsealed results f 
the unseen end-of- year examinations u 
shown in Table 3 below; the examination 
papers were set by each academic respon- 
sible for lecturing each segment of the 
course but were no t necessarily marked by 
that person, in fact most of the papers were 
marked by other members of the Depart- 
ment. 

Grades in the Universi ty of Queensland are 
awarded on a seven point numerical scale 
from one through seven with a grade of 
four being a Pass and grades of fi ve, six and 
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seven being superior passes in ascending 
order * grade of three (usually awarded to 
papers with a mark just below 50 per cent) 
is a non-qualifying pass while grades of 
two and one are unambiguously failures. 
The examining conventions at the Univer- 
sity of Queensland as expressed in the 
guidelines issued by the then Professorial 
Board (now the Academic Board) are that 
grades should approximate the percent- 
ages indicated in Table 3. Final grades for 
the course are determined by results of 
progressive assessment as well as end-of- 
year examinations. 

Table 3. Results End-of-Year Examination in ECl 10 
Introductory Economics, 1986. 



Percentage of Students 



Percentage First Tuper 




Second Paper 


Mark Grade 




Part A PartB* 


040 1 


11.5 


47.6 14.8 


41-49 2/3 


20.4 


10.1 4.2 


50-64 4 


43.3 


21.3 193 


65-74 5 


17.6 


10.1 18.5 


75-84 6 


6.7 


8.5 24.4 


85+ 7 


0.7 


2.4 18.8 



* Segment of the course to which the CML system 
applied. 

In order to assess the results in Table 3 it is 
necessa.y to consider the 'a priori' expecta- 
tions one would hold in respect of the three 
components of the er.d-of-year examina- 
tion. Since the segment of the course to 
which the CML system applied and to 
which the Second Paper Part B results 
apply was the last segment of the course 
and because some knowledge of the seg- 
ment covered by Part A is considered nec- 
essary as a pre-requisite for Part B, our 'a 
priori' expectations are that results in Par t B 
would be no better than in Part A or in the 
First Paper and may be significantly worse. 

In the light of this expectation, our in terprc - 
tation of the results in Part B, which are 
statistically significantly different from 
those in Part A and the Fir. t Paper, is as 
follows: 



1. the results in Part B are consistent with 
previous experience in Keller Plan and 
PSI courses; 

2. the results in Pan B discriminate clearly 
between students with passing and fail- 
ing grades which we regard as a desir- 
able feature m its own right; 

3. in 1986 this discrimination meant that 
very few students would have im- 
proved their adjusted mark in Part B as 
a result of the CML tests as can be seen 
by consulting Table 2; 

4. the results of PartB may reflect a Haw- 
ihorne effect due to strong student ac- 
ceptance of CML as disclosed in the 
results of the Student Questionnaire so 
that the superior results in P^nBmaybe 
due in part to inducing students to 
devote more rime and effort to the work 
of Part B. 

5. given these qualifications and other 
matters which cannot be tested, we 
would conclude that the results in Part 
P are consistent with the view that stu- 
dent performance in Part B of the coui se 
has been improved through implemen- 
tation of CML. 

The Cost of CML 

The costs of CML fall into the following 
categories.hardware costs, software costs, 
costs of establishing the testbank and the 
operational procedures and material run- 
ning costs. 

Hardware costs 

Under the University of Queensland's re- 
source allocation and accounting proce- 
dures, the costs, both initial capital and 
running, are not allocated to opc r ational 
units' budget and the hardware is *reat jd 
as a common resource so it is not posi ibl : to 
know how much of the hardware cos! is 
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properly allocable to this CML project. For 
the purposes of making cost comparisons 
we assume that the rental costs of the VAX 
for the period of the project were $25,000. 

Software costs 

The all-up cost of the CML package, sup- 
plied by CBTS in 1985, was $18,000. 

Costs of establishing the testbank and the 
operational procedures. 

Major costs of the project were the cost of 
establishing the testbank, which Jon Stan- 
ford estimatesas taking at least three weeks 
full-time work, and ihe costs of setting up 
the project which took two months of 
Howard Cook's time. Ensuring the project 
worked meant that both authors had to 
forget any ideas of 9 to 5 days, and during 
the period CML was used by students, both 
worked weekends and most nights of the 
week. 

Material running costs 

Costs for consumable supplies to keep the 
project running (paper and ribbons) were 
trivial. Total costs were less than $500 and 
amoun ted to an average cost per test gener- 
ated of approximately 11 cents. This cost 
also included the processes of marking the 
test, issuing results to the student, keeping 
records and providing data for analysis of 
student and question bank performance. 

Evaluation. 

Our evaluation of CML suggests that it is 
cost-effective; if we allocate all costs, except 
for the time of the authors in developing the 
project, to the first year of the project, we 
estimate the average cost per student ib 
approximately $70. If the cost of the soft- 
were is amortised over three years, the 
average cost falls to $50; if the cost of the 
hardware is amortised over the expected 
li f e o c the hardware, the average cost falls to 



approximately $30. These costs have to be 
compared with the marginal funding avail- 
able to the Department in respect of each 
additional student; in 1985 this was $2500 
per student or over $600 if allocated by the 
straight line method to ECHO. 

That CML is cost-effective is emphasised 
when it is remembered that the establish- 
ment costs (first year costs) are high, and 
second and subsequent year costs are much 
less than the initial year costs. In addition, 
in later years, CML can be routinised so that 
it can be maintained and expanded with 
less skilled and dedicated staff than is re- 
quired to establish it in the first place. In 
1987 CML is being used in three first-year 
courses and one third-year course; the* asts 
of expansion in this way are much less Khan 
the establishment cos's. 

Other issues 

CML enables more students to be taught 
effectively with given resources; it enables 
a saving of resources used in the repetitive 
areasof markingsimple testsand in record- 
ing results and other data; these resources 
can be more effectively used in other areas 
of course management and design. CML 
also enable students to gain more control 
over the pace at which they progress 
through the course; if this feature of CML 
were expanded we estimate that a signifi- 
cant proportion of studentscould complete 
the course requirements in less than a 
semester. 

In order for these benefits of CML to be 
captured completely, the University needs 
to change certain features of its organisa- 
tion. One horror story will suffice to illus- 
trate this point. The complete student rec- 
ords in ECHO were maintained on com- 
puter in 1986, the University administra- 
tion was of fered the lists in any one or all of 
the following ways: 

• in hardcopy printed by computer in any 
format; 
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• on floppy disc; 

• on file on the University mainframe 
transferred via Kermit from our floppy 
or from the VAX. 

We were amazed to find that the only for- 
mat they would accept was their forms 
completed by hand! 

Conclusions 

From the experience of this project of using 
CML for formative assessment in a large 
first-year economics course in 1986, we 
conclude that: 

1. It had improved student performance 
by as much as 40 per cent on the final 
examination in 1986 (we can aiso note 
that it significantly reduced the percent- 
age of students who obtained less than 
50 per cent in the examination as com- 
pared with the results of in 1985); 

2. Students had positive responses to 
CML; 

3. Students found that CML supported 
their learning; however, many re- 
quested increased learner control from 
CML; 

4. Student motivation in the coarse in- 
creased; 

5. CML was cost-effective; 

6. The costs of establishing CML are rela- 
tively high; but CML offers significant 
cost advantages in later years of use; 

7. A major cost of establishing CML iSthe 
use of skilled and dedicated s*aff time; 

8. CML can improve productivity in 
teaching a large first year course in two 
ways: through allowing academic staff 
to manage more students with given 
resources and in enabling students to 
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progress through the course more 
quickly and at a higher level of achieve- 
ment; 

In order to reap these benefits organisa- 
tional changes will be necessary. 
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There is a general lack of knowledge in the other 
States of Australia about current developments 
in the Northern Territory. Those who visit the 
Northern Territory are surprised to find the 
pervasiveness of computing throughout all lev- 
els of education. Computing technology has 
been embraced by a population characterised by 
isolation from the rest of Australia. 

This paper reviews the facilities/ availability 
and use of computers in tertiary education both 
on campus at Darwin Institute of Technology, 
the University College of the Northern Terri- 
tory, and the Alice Springs College of Technical 
and Further Education, and off campus through 
the Northern Territory Ope* 1 College and the 
Northern Territory External Studies Centre. 



TheNorthern Territory hasa population of 
160 000 people who are isolated from the 
rest of Australia. In spite of its small popu- 
lation and the huge area it covers, comput- 
ers have become widespread throughout 
all levels of education. The Northern Terri- 
tory has five organisations which provide 
Advanced Education, Technical and Fur- 
ther Education and facilities for external 
studies in computing. Government de- 
partments are closely associated with these 
activities, and in spite of the difficulties 
imposed by isolation, there is a healthy 
interest in research and post-graduate 
studies, and Computing in the Northern 
Territory is very much alive and well. 

Darwin Institute of Technology (DIT), 
originally established as the Darwin Com- 
munity College in 1974, provides the cen- 
tral focus for a large proportion of the 
many computingactivities in the Northern 



Territory. The primary teaching facilities of 
the Institute are provided by a VAX Cluster 
and, in addition, many exciting develop- 
ments have taken place with a number of 
joint educational facilities being set up 
between DIT, government departments 
andothei organisations. These include the 
establishment of an Information Technol- 
ogy Training Centre, a Computer Educa- 
tion Centre and a research ard develop- 
ment group, the Special Interest Group - 
Computer Oriented Nurses (SIGCON), 
specifically concerned with the relation- 
ship between computers and the nursing 
profession. 

Information Training Technology 
Centre (1TTC) 

The Information Technology Training 
Centre (ITTC) is a joint facility provided by 
Darwin Institute of Technology and the 
Northern Territory Treasury, Division of 
Computing and Information Technology 
(NCOM) which is responsible for provid- 
ing suitable computer training courses for 
all Northern Territory Government em- 
ployees. The Centre provides up-tc-date 
IBM equipment for use by Institute lcctur 
ers and students and training in microcom 
puter and mainframe applications for 
Public Sector employees. 

The centre is situated in the Faculty of 
Business and consists of a Mainframe Ter- 
minal Laboratory and a Personal Com- 
puter Laboratory. The Personal Computer 
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Laboratory is equipped with 10 XTs, each 
with single disk drives and a hard disk, and 
the Mainframe Laboratory has 12 telex ter- 
minals connected to the Northern Territory 
Government IBM 3090 computer. Allof the 
courses offered in the Centre concentrate 
on giving "hands on" experience with the 
relevant system or package. 

The courses utilising the 3090 are mainly 
for Public Sector employees, who use the 
Government networking facilities. The 
courses offered cover a diverse range of 
materials including EASYTRIEVE+ and 
SPSSX. Courses utilising the Personal 
Computer Laboratory cover material such 
as SYMPHONY and SMART and also a 
SM ARTLINK course, which is designed for 
mainframe to microcomputer communica- 
tions in the GAS system. These courses are 
usually one or two days in duration and 
form a sequence which are taught by either 
DIT lecturing staff or by NCOM staff. DIT 
computing students have access to the 
ITTC laboratories where appropriate. 

The Computer Education Centre 

The Computer Education Centre is a joint 
facility provided by Danvin Institute of 
Technology and the Northern Territory 
Department of Education. The Centre 
coordinates the use of computers in educa- 
tion in all Northern Terri tory schools and is 
responsible for providing the following 
services to the Education Department, 
D.I.T and the community: 

• inservLe training in computer use and 
curriculum applications; 

• pre-service training in computer use 
and curriculum applications; 

• post-graduate studies in educational 
computing; 

• training for all members of the school 
community, including parents, in the 
educational uses of computers; 

• software evaluation; 

• maintenance of a software lending li- 
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brary in conjunction with the Education 
Department's Library Services; 

• evaluation of new technology and ma- 
chines to determine their applicability 
in schools; 

• advisory visits to schools and regions 
to give curriculum and systems advice 
and inservice training; 

• coordination and support for regional 
education centres; 

• information dissemination through 
publications; 

• liaison with national project teams for 
development of the uses of computer 
technology as an educational resource; 

• resources for award and non-award 
computing courses offered by D.I.T. 
and 

• fund-raising courses. 

The Computer Education Centre operates 
as a functional unit of the Division of 
Computing and Mathematics and is situ- 
ated in the Faculty of Applied Science. It 
consists of an Apple lie Teaching Labora- 
tory, an Apple Macintosh Teaching Labo- 
ratory and a Student Access Room. In 
addition, the Centre houses a range of per- 
sonal computers, such as the SBC Micro- 
computer and the Commodore 64 which 
are available in a number of Territory 
Schools, together with a number of oth*:* 
machines under review. 

The Centre is currently staffed by tvo 
Senior Education Officers from the Depart- 
ment of Education, who are attached to 
D.I.T. as members of the academic staff, 
and one lecturer from the Division of 
Computing and Mathematics. Lecturers 
from the Department of Computer Science 
work closely with the Centre and utilise the 
facilities on a regular basis for teaching 
purposes. 

SIGCDN : The Special Interest Group 
- Computer Oriented Nurses. 

The impetus for the formation of SIGCON 
came from a group of Registered Nurses 
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who had completed a computing unit as 
part of a Diploma of Applied Science. The 
interest expressed in, and the lack of 
knowledge of, the computer as a tool for 
Health Care led to some initial research 
being undertaken in this area which has 
now expanded into the areas of knowl- 
edge-based systems and applications of 
intelligent CAL systems. Practising 
nurses, lecturers in Nurse Education and 
lecturers in Computer Science comprise the 
r re membership of SIGCON. 

Health care practitioners in the Northern 
Territory are faced with unique problems 
that require specialised training, particu- 
larly in areas such as Aboriginal Health and 
Community Health Care in remote areas. 
Members of the nursing profession regard 
the computer as a tool that could aid such 
training through CAL techniques and the 
use of knowledge-based systems and they 
feel that participation in the development 
of such tools will enhance their profes- 
sional standing. 

The group operates under the auspices of 
DIT and the Northern Territory Branch of 
the Australian Computer Society. It has 
access to the facilities of the Department of 
Nursing and the Computer Education 
Centre at DIT and is currently negotiating 
with Royal Darwin Hospital for research 
facilities. In addition to the research activi 
ties SIGCON publishes a regular newslet- 
ter and has run several workshops and 
seminars for its members. 

Other Teaching Facilities in the 
Northern Territory 

The Alice Springs College of Technical and 
Further Education (ASCOT) has three 
computer laboratories, one based on the 
Burroughs B26 minicomputer system and 
the other two based on personal comput- 
ers. These are utilised by award courses 
offered in Business, Secretarial Studies, 
Management and Hospitality Manage- 



ment. ASCOT also runs seminars and 
workshops for outside users such as Gov- 
ernment departments and fee paying 
courses. Modems are provided for access 
to other tertiary centres for external study 
purposes. 

The Northern Territory External Studies 
Centre situated at DIT coordinates most of 
the interstate tertiary studies undertaken 
by Northern Territory residents, including 
the activities of a large number of comput- 
ing students. The Centre provides tutors 
for many of these students and is currently 
co-ordinating the activities of a group of 
post-graduate computing students. 

The newly established Northern Territory 
Open College is designed to provide post- 
secondary courses for isolated residents 
and usea the computing facilities of rural 
schools to provides a number of short 
courses in computer studies out of school 
hours. The Open College has two centres in 
the Darwin Rural Region and other centres 
inKatherine, TennantCreek, Alice Springs 
and Nhulunbuy. 

The University College of The Northern 
Territory (UCNT) has only been iecently 
established. It is situated in Darwin and 
currently has a MicroVAX II and three 
teaching laboratories. At the moment these 
are used only for one semester introduc- 
tory courses. 

Although many advances have been made 
in computing throughout the Northern 
Territory, there is still potential for future 
development. It is anticipated that the 
School of the Air and The Northern Terri- 
tory Secondary Correspondence School 
will provide facilities for remote users of 
computers. A link between Darwin Insti- 
tute of Technology and the University 
College of the Northern Territory may be 
established to fully utilise and extend the 
facilities of both institutions and the Com- 
puter Education Centre intends to extend 
its services to the regional education 



382 

centres through communication systems 
such as Viatel. The pervasiveness of com- 
puting throughout all levels of education 
will become even more evident in the fu- 
ture. 

Appendix: Computing facilities 
at Darwin institute of Technology 

On 30th April 1987, Darwin Institute of 
Technology had approximately 1500 stu- 
dents enrolled in Advanced Education 
(degree or diploma level) courses and 3500 
students enrolled in Technical and Further 
Education (TAFE) courses. In addition to 
students enrolled in award courses 3500 
students attend fee paying courses at the 
Institute every year. Darwin has a popula- 
tion of 72000 so that the educational needs 
of nearly 12 percent of the population are 
met by the Institute. 

Some 350 students enrolled in award 
courses have accounts on the main frame 
system and a similar number utilise the 
various micro-computer facilities. 

Darwin Institute of Technology has a 
VAX/780, a VAX/750 and a micro- Vax 
which are clustered together and are util- 
ised by staff and students. 
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The author has taught in a variety of 
institutions and countries and been 
Involved in computer education for 
over twenty years. The current posi- 
tion held by the author is that of Lec- 
turer in Computer Science specialising 
in Technical Systems Analysis, Project 
Management and the Applications / 
User Interface. She is the convener and 
technical advisor to the Special In terest 
Croup, Computer Oriented Nurses 
(SIGCON) which operates in the 
Northern Territory. This group is 
involved in computer education and 
research into the use and development 
of CAL systems related to the nursing 
profession. The author is currently 
developing an expert system which 
will enable nurses to gain advice on 
areasof nursing specifically relevant to 
the tropics. This system should be of 
great assistance to both nursing train- 
ers and nursing staff in isolated areas. 
The knowledge required of nurses is 
much mere general than that required 
of doctors, although not as in-depth. A 
major component in the development 
of the expert system is in discovering 
ways of extracting knowledge from 
people with no technical background 
in computing and in developing ways 
to access large amounts of general in- 
formation in a reasonable time. There- 
fore the research falls firmly in the 
areas of knowledge engineering, 
knowledge representation and pattern 
recognition. 
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In this paper, we present several types of ques- 
tions which are suitable for computer assisted 
examination of fundamental programming 
courses. Computer implementation and analy- 
sis of the questions are also addressed here. 
Human factors in designing the examination 
questions are also considered. The choice of 
questions and the appropriateness of imple- 
mentation are discussed. The analysis and argu- 
ment presented here can justify our design and 
implementation. 



It has always been a hassle for students and 
teachers at the end of each icrm or semester, 
Students are busy at preparing for exami- 
nationsand the teachersarebusyat making 
and grading examinations. Very often 
students have to come to a specified class- 
room at a scheduled time to take the exam 
and the teachers must be present at the 
exam. After the exam, teachers and graders 
must spend a large amount of time to de- 
sign a grading scheme and to grade the 
exam papers. This has been quite a labori- 
ous and error prone job. Students often 
come to complain about their grades after 
the exam papers were graded. This raised 
our interests in implementing a computer- 
assisted examination system to deal with 
above problems. 

The aims of computer-assisted examina- 
tion are to give prompt processing of exam 
data for administrations and to reduce the 
labour and errors for grading exam papers. 
Computer-assisted examinations can pro- 
vide flexible time and place for examina- 
tion. In addition, properly designed exams 



can be error free and the grading can be 
completely computerized. Since we are 
discussing exams for computer program- 
ming courses, there are also certain ques- 
tions which are natural to computer exam 
but not paper test. 

However, not all examinations can be 
completely computerized in our current 
technology. Exam questions involving 
natural language descriptions are espe- 
cially difficult to automate. Therefore, we 
must choose several types of questions 
which cover a large variety and are easily 
computerized. The simplest are the yes/ no 
type of questions and multiple choice 
questions.These questions have been suc- 
cessfully used in TOEFL and GRE. But 
these questions are not sufficient for funda- 
mental programming courses. Examinees 
may get a certain number of points simply 
by guessing and making random choices. 
These questions are also too simplistic to 
prevent cheating and plagiarism if the 
exam is to be taken by many people at 
different times. 

In this paper, we consider several types of 
questions besides the yes/ nc type and the 
multiple choice type. We will also analyze 
the scoring probability of the questions in 
each type. The advantages and disadvan- 
tages of each type will be considered. 
Examples of each type will be given. 
Computer implementation of the exam 
questions will be discussed. 
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Types of Examination Questions 

In this section, we describe several differ- 
ent types of exam questions. The scoring 
probability of each type is also analyzed. 
An example will be given for each type. For 
completeness, we also include the yes/no 
type and the multiple choice type. When 
we describe the types of exam questions, 
we also consider some 'human factors', 
which measure the effectiveness of the 
questions while being used against stu- 
dents. 

YES/NO Type Questions 

A question in this type requires a simple 
answer, either a YES or a NO. Even withou t 
an understanding of the problem, an exam- 
inee has a 50% chance of getting a correct 
answer. Following is an example question 
of this type. 

Question 1. In a digital computer, 
information is represented by a se- 
quence of tones with continuous fre- 
quency increments? 

Answer: yes( ) / no( ) 

Analysis for yes/no questions is given be- 
low. From here on we will use 'character 7 
for characteristics and 'prob and HF' for 
probability and human factor. 

• (Character) This type of questions is 
simple and easy to grade. It is very 
useful to test student understanding of 
basic concepts. 

• (Prob and HF) The 50% probability 
makes it susceptible to cheating and 
pure guessing. 

Multiple Choice Questions 

An answer to this type question usually 
requires the examinee to choose one from a 
set of n answers provided to him. Without 



an understanding of the problem, the ex- 
aminee has 1 /n chance of getting a correct 
answer. Since the examinees normally scan 
from the first answer tc the last answer, it 
would be advisable to place the correct 
answer for each question in the last few 
answers. Following is an example. 

Question 2. A recursive function is a 
subprogram which 

A. has multiple parameters 

B. can always be converted into it- 
erative loops 

C. calls itself indefinitely 

D. can be implemented using stacks 

Only one answer is correct in this case. 
With a random choice a student has 25% 
chance of getting the right answer. This is 
better than the yes/no questions. The 
analysis is as follows. 

• (Character) Multiple choice questions 
are still simple and easy to grade. They 
are also useful for testing basic under- 
standing. But this type of questions is 
trickier than yes/no type questions. 

• (Prob and HF) A probability of 1/n is 
still susceptible to cheating and the 
answer to a specific question is easily 
memorised ^ind passed onto another 
person. 

Even though the yes/no type and the 
multiple choice type have certain disad- 
vantages, they still prevail in exams. This is 
due to the simplicity of such types of ques- 
tions. 

Multiple Match Questions 

This type of questions usually contains a 
descri ption and two lists of items, each item 
inone list must be matched toan item in the 
other list. Sometimes we may arrange to 
have more than two lists for matching. 
Suppose that we have two lists, each of 
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which has n items. If the examinee is totally 
ignorant about the question, the probabil- 
ity p(k,n) for him/her to get k correct an- 
swers from a total of n answers is approxi- 
matelyl/(ek!). This is because 

p(k,n) = total # matches of k correct and (n - k) \\Tong 

total # of matches 
and the number of permutations with ex- 
* actly k matches (PfeifferSchum, 1973) is 

n n-k 44)i 

( k )(n-k)!I |B0 i! 

which is approximately n! e 1 . 

n n-k H) 1 n 

( k )(n-k)!l^ n ( k )(n-k)! , 
p(k,n) = = = — 

n! erf & 

Apparently, the larger k is, the lower 
probability of getting it right. Following is 
an analysis for multiple match questions. 

* (Character) Multiple match questions 
are simple to do and easy to grade. 
Partial grades are given according to the 
number of correct marches. 

• (Prob and HF) Probability is l/(ek!) 
The probability shows that scoring by 
random guess is very difficult. These 
questions are net susceptible to cheat- 
ing and plagiarism because memoris- 
ing so many matches is quite difficult. 

Although multiple match questionsappear 
similar to multiple choice questions, they 
have quite different human factors and 
probabilities. 

Program Trace and Selective Types 

One type of exercises, the trace of a pro- 
gram run, is particularly helpful for stu- 
dents in fundamental programming 
courses. The student must trace a program 
segment line by line to find out what are the 
output data. There are three typical types 
of trace questions, the direel output type, 
the selective choice type, and the selective 
match type. Ec:h of these types will be 
examined next. 

O 
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THE DIRECT OUTPUTTYPE. In this type 
of questions, a program segment is given. 
The student is supposed to trace the execu- 
tion of the segment and to report theoutput 
sequence. Following is an example. 

Question 3. Trace the execution of the 
procedure f(5). Show the output se- 
quence produced by the write state- 
ment. 

function £ (n : integer) : integer; 

var t : integer; 

begin 

if n < u 1 then begin write (1); f 
1 end 

else begin t :« n*f (n-1); write (n); 

f : ■ t end; 

end; 

The student is required to list the sequence 
of numbers output by the function with a 
parameter 5. A sequence of five numbers is 
produced by f(5) and the student must 
trace the program to produce this se- 
quence. Analysis is shown below. 

• (Character) This type of questions may 
range from easy to very hard depend- 
ing on what are given in the program 
segments. Partial grades can be given 
according to the numbers of correct 
answers and wrong answers in the 
output sequence. Some questions can 
be very challenging. 

• (Prob and HF) Probability for this type 
relies on many factors and is not easily 
calculated. But it is obvious that getting 
a correct sequencecanbe quite difficult. 
It is also hard to memorize the entire 
sequence and is thus less susceptiole to 
cheating. 

THE SELECTIVE CHOICE TYPE. In this 
type of questions, a program segment is 
given together with an output sequence. 
The student is supposed to trace the execu- 
tion of the segment and to select the ele- 
ments in the sequence which are produced 
by the segment. Following is an example. 

30 5 
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Question 4. Which of the following 
numbers cannot be produced by the 
write statement in the following pro- 
gram segment. 

i 0; j 1; 

for k :-l to n do (* where n is greater 

than 1 *) 

begin 

temp i; i :« j; j i + temp; 

write (i) 

end; 

Output numbers: 
1,2, 3, 4, 5, 7, 8, 11, 13J 7, 21, 25, 30, 34 

The student must identify, from the output 
sequence, the numbers which can be pro- 
duced by the write statement in the pro- 
gram segment. The probability p(k,m,n) of 
getting k correct answers, from a sequence 
of n numbers among which m are correct 
answers, is 



n m n-m 



p(k,m,n) = - 

n n 
*i = k<i> 

where k < m since there are a total of m 
correct answers only. The derivation of the 
probability is neglected to save space. 
Analysis is as follows: 

• (Character) This type of questions also 
ranges from easy to very hard depending 
on what are given in the program seg- 
ments. Partial grades can be given accord- 
ing the numbers of correct answers and 
wrong answers. Grading is easy. 

• (ProbandHF) 



p(k,m,n) = - 



n m n-m 
^i«k( k X i-k ) 



* = k<i> 



It is bit difficult to comprehend this for- 
mula of probability. But it suffices to say 
that getting a completely correct sequence 



is very hard. Also this type of questions is 
not susceptible to cheating. 
THE SELECTIVE MATCH TYPE. In this 
type of questions, several program seg- 
ments are given together with several out- 
put sequences. The student is supposed to 
trace the execution of the segment and to 
select the elements in the sequence whic*. 
are produced by the segment. An example 
is given below. 

Questions. Three programs shown below. 
A table is also given for filling in the an- 
swers. Each row corresponds to a specific 
value of i (the index variable) and each 
column in a row contains the output for one 
of the programs. Fill in the circles in each 
row with the corresponding program 
names (A, B, or C) to indicate the programs 
which produce the outputs. 



program A; 

var i,x,y,z:integer; 
begin 

for i:=l to 5 do 
begin 
x:=round 
(sqr(i/2.0)); 
y:=x mod 3; 

z:=x*y; 
end; 
end. 



program B; program C; 

var i,x,y,z:integer; va&yziifcger; 

begin begin 

for i:=l to 5 do for i:=l to 5 do 



begin 
x:=trunc 
<sqr(i/2.0)); 
y:=x mod 3 - 

z:=x*y; 

end; 

end. 



begin 

x:=trunc(sqrt(i/ 

2.0)); 
1; y:=x mod 

3+1; 
z:=x*y; 
end; 
end. 



index 


X 


y 


z 


X 


y 


z 


x y z 


i=l 


0 


-l 


-1 


0 


i 


i 


0 0 0 


i=2 


1 


2 


3 


1 


i 


2 


1 0 1 


i=3 


2 


i 


3 


2 


2 


4 


1 2 3 


i=4 


4 


0 


4 


4 


i 


5 


1 2 3 


i=5 


6 


-l 


5 


1 


2 


3 


6 0 6 



The siuuent must identify, on each row, the 
program which produced the output in a 
column. Each row requires a match and the 
probability for getting k 4 correct answers in 
the i-th row is l/tek,!). Let k denote the total 
number of correct answer. Then k <n X m 
where k = 1^+1^+...+ k n . Since the matching 
in each row is independent of the ^ther 
rows, for a question with m programs and 
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n rows of answers, the probability p(k / m / n) 
of getting k correct answers, is approxi- 
mately 



p(k,!U,n) 



{ y ' 



i = l 



because the number of combinations for 
getting k correct answers out of n rows is 
equivalent to distribute k nondistinct ob- 
ject into n distinct cells (Liu / 1968] and the 
result is( n4kl ). 

k 

In calculating the above probability, we 
have assumed that the probability for each 
combination of \, where X n k, = k , is the 
same. U1 

Tollowing is an analysis of this ty\ e of 
questions. 

• (Character) This type of questions are 
usually difficult to do. Partial grades 
can be given according to the numbers 
of correct answers. Grading is easy. 

• (Prob and HF) p(k,nvn) is approxi- 
mately t n , 

I • 

This type of questions is not susceptible to 
cheating and is hard to do. But they are 
very useful exercises for learning to read 
and digest programs. 

Our discussion on program trace questions 
stops here. Program trace questions are 
very important in fundamental program- 
ming courses. The typesof trace questions 
we have chosen are easily computerized. 
Wc hvjvc implemented these q^es^c^s and 
the results are satisfactory. 

Debugging Questions 

Debugging is an important step in pro- 
gramming. It is especially important for 
students in fundamental programming 
courses to learn about debugging. Debug- 
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ging syntax errors are relatively easy and 
modern compters normally report very 
detailed error messages. But it is more 
difficult to debug semantic errors. Hence, 
it is essential to include such questions in 
the examinations. An example of debug- 
ging question is given below. 

Question 6. A recursive function FIND- 
MIN is shown below. The function tries to 
find Ihe minimum value element in an 
array X[1..N]. The value of the minimum 
element is returned. There are two (seman- 
tic) errors in the following program. Check 
the program and mark the erroneous state- 
ments. Also, give the correct replacements 
for the two statements. 

type INARRAY = array [1..N] of integer; 



function FINDMIN(var X:INARRAY; 
N:in teger) :in teger; 
var min-of-rest: integer; 
begin 



if N=l then FINDMIN := X[l] 
else 
begin 

rran-of-rest:=nNDMIN(XN-l); [411. 
if min-of-rest<X[N) then 



I 
I 

Erroneous 
Statements 
W 

(HI 
[211 
[3]l 



FINDMIN := X[N] 
else FINDMIN := min-of-rest; 
end 



end; 



[5]Corrected 
Statements 
[6)1 
[71! 
[811 
I 



This type of questions requires a close ex- 
amination of the program segment and a 
careful check of each statement and each 
variable. The probability of locating the 
erroneous statements is ( n ) 

m 

where n is the total number of statements 
and m is the number of erroneous state- 
ments. It also requires much effort to co r - 
rect the m statements. 

Programming Questions 

This type of questions require that the stu- 
dent to write a simple procedure or func- 
tion and to run it on line. This also needs to 
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provide a simple editor for on-line editing. 
However, there is no easy and fair way to 
grading. Either a simple no points/ full 
points grading is employed or an off-line 
grading scheme is employed. We have also 
implemented this type of questions in our 
computer-aided examination system. 

Implementation 

The types of examination questions and 
some other types of questions have been 
implemented on a WIC AT graphics work- 
station. To improve human-computer in- 
teraction and help the student during the 
exam, we have included many features to 
simplify th?. use of the system and to make 
it more user-friendly. 

We have taken fully advantage of the 
graphics facility of the WICAT system. 
Along with each exam question, there are 
also various i nstructions for u sing the facil- 
ity displayed. The user can use the system 
without referencing any manual or guide. 
This provides a suitable environment for 
examination. A few screen imagines are 
shown in Figures 1 through 4. 

Summary 

A set of questions suitable for computer- 
aided examination are presented. These 
questions are also analysed to show their 
appropriateness for computer implemen- 
tation. Thehuman factor consideration and 
the probability for anti-plagiarism are also 
discussed. 

These questions have been implemented 
on a graphics workstation. Such a system 
has demonstrated many advantages. It is a 
step toward a full automated system for 
computer-aided education. We are looking 
at other types of questions to be incorpo- 
rated in our existing system. Some intelli- 
gent tools will considered for future exten- 
sion in this area. 
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QUESTION #1 



I > 0; 

j > 1; 

for k :« 1 to n do 
begin 

temp :« i; 

i > j; 

j > i + temp; 
wrlteln(i); 
end; 



1. Which of the following numbers cannot 
be produced by the "writeln H statement in 
this program? 

Please mark the numbers that cannot be 
produced. 



RETURN 




j 


i 



Move 



MARK 



BACK 



H 0 0 B S 0 S 

2. What is the name of the series of numbers this program generates? 



Figure 1: Screen image of a multiple selection question 
QUESTION #1 



I > 0; 
J >1; 

for k 1 to n do 
begin 
temp :» i; 

j :« i + temp; 
writeln(i); 
end; 



1. Which of the following numbers cannot 
be produced by the "writeln" statement in 
this program? 

Please mark the numbers that cannot be 
produced. 



RETURN 



MOVE 



MARK 



BACK 



[5i¥ 



DD DD H DEI 03 DEI s 

2. What is the name of the series of numbers this program generates? 



Figure 2: After some choices are selected. 
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QUESTION #2 



For each concept In the left set, find a best match one from the right 
set, and put the relative number In the proper blank. 



BINARY VALUE 



D 



SOFTWARES 



D 



OUTPUT DEVICE 



} hardwares] ^) 

ALGR1THM j f) 



COMPILER 



D 



SENCONDARY STORAGE 



D 



DCNE 



1. Translate & excute program 



2. CPU 



3/Top down decomposition 



4. Sequence of steps which produce a result 



5. Specify Instructions 



6, Printer 



8. Digits 0-9 



7. Translate program 



9. Pascai program 



11. 0 *s & 1*s 



10, Psuedo-code 



12. Floppy disks 



13. Carry Instructions j 14. Keyboard j 



Figure 3: Screen image of a multile match question 
QUESTION #2 

For each concept in the left set, find a best match one from the right 
set, and put the relative number in the proper blank. 



1. Translate & excuto program 
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Fgiure 4: After several matches were made 
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Computer Assisted Learning at the University 
of Otago 



Marjan Vlugter, CAL Consultant / Programmer 
Computing Services Centre, University of Otago 



The University of Otago has made a commit- 
ment to the development and use of CAL tech- 
niques in the University. It is the first university 
in New Zealand where positions have been 
created with specific responsibilities for Com- 
puter Aided Learning: one in the educational 
area attached to the Higher Education Devel- 
opment Centre and one in the technical area 
attached to the Computing Services Centre. 
This paper will give a historical overview of 
CAL at Otago, describe the current situation 
and outline the changes that are taking place. 



Over the last two years CAL at Otago Uni- 
versity has changed. In fact, some great 
strides have been made and CAL at our 
university could be said to be growing up 
fast. This may be attributed to three factors: 

* financial support 

* establishment of advisory services 

* growing popularity of the Macintosh™ 
computer 

We will first look briefly at the growth of 
interest in CAL over the last two or three 



years. We will then look at the factors that 
influenced this and at the situation at the 
present time. Finally, we will look at some 
of the directions and plans for the future. 

CAL then and now 

In 1985 six departments had made a firm 
commitment to using CAL with classes (see 
Table 1). The Commerce Department used 
a computer laboratory to teach their stu- 
dents about the use of programs in the 
business world. Teaching laboratories 
weiebeing setup foruseinPsychologyand 
Computer Science. Several departments 
were either evaluating the possibilities of 
CAL or ready for development work. Six 
departments received a microcomputer for 
teaching development purposes. Four of 
these were not yet involved in using CAL. 
The Anatomy Department was carrying on 
an experiment (started by the Orthopae- 
dics Department) in the evaluation of inter- 
active videotape. 



Table 1. 1985 



Department 


Computer 


Type of use 


A »t_ .11.. 


Appic II 


simulations 


Clinical 






Biochemistry 


VAX 


problem solving exercises 


Economics 


Apple II 


simulations 


Education 


Apple II 


teaching about CAL 


Mathematics 


Apple II 


demonstrations and simulations 


Microbiology 


Apple 11 


laboratory experiments 


Pharmacology 


Apple II 


laboratory experiments 






and demonstrations 
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By 1987 sixteen departments are using 
some form of CAL in classes (see Table 2). 
It is interesting to note that of the 9 new 
users, 6 use the Macintosh and that 2 of the 
older established users have switched to or 
have added the Macintosh. The Physiology 
Department has replaced their oscillo- 
scopes with a laboratory full of Macin- 
toshes, using locally developed, very so- 
phisticated, software. There are plans to 
extend the use of the Macintoshes from 
laboratory tools to incorporate CAL exer- 
cises as well. There are similar plans in the 
Physics Department. It is expected that by 
this time next year another eight or ten 
departments will be using CAL applica- 
tions and that those who started off care- 
fully and convent' v ,na!ty will have ven- 
tured out in more diversified use of CAL. 
The reason for this growth should be 
mainly attributed to the three factors men- 
tioned above and we shall now look at each 
of these factors individually. 

Table Z 1987 



Financial support 

Because it was noticed that there was an 
increase in applications which expressed 
an interest in developing Computer As- 
sisted Learning units and which requested 
computer equipment for use in teaching, a 
working party was formed in 1984 in order 
to obtain an overview and evaluation of 
current and possible future activities in 
CAL and to advise on the implications for 
funding policy. 

The working parry visited 20 departments 
and groups within the University of Otago 
and reported in June 1985 that there were 
sufficient interesting developments of a 
practical sort to warrant a modest increase 
in support for CAL in the University. Three 
levels of support were suggested: 

• expert advice and information in the 
early stages 



Department 


Computer 


Type of use 


Anaesthetics 


Apple II 


simulations 


Anatomy 


Macintosh 


drill & simulation 


Clinical 






Biochemistry 


VAX 


problem solving exercises 


Dentistry 


Macintosh 


drill 


Economics 


Macintosh 


simulations 


Education 


Apple II 


teaching about CAL 


French 


VAX 


drill 


Geology 


Macintosh 


numerical analysis 






simulations (spreadsheet) 


Mathematics 


Apple II & 


demonstrations and Macintosh simulations 


Medicine 






(Wellington) 


VAX 


drill 


Microbiology 


Apple II 






(more units) 


laboratory experiments 


Pharmacology 


Apple II 


laboratory experiments 






and demonstrations 


Physics 


Macintosh 


simulations & concept 






learning 


Russian 


Macintosh 


drill 


Textiles 


IBM 


drill and tutorial 


Zoology 


Macintosh 


drill and simulations 
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• practical support (hardware, program- 
mingassistance) when ready to proceed 

• establishment of CAL units (consisting 
of 5 - 1 0 machines) when ready for class 
use 

The woi king party also made the following 
recommendations: 

• the appointment of an educational 
adviser and a computer programmer to 
give advice and assistance in CAL 

• provision of some out-of-hours CAL 
computing facilities for students 

• a one day exposition of CAL to foster 
communication among people inter- 
ested in CAL 

It is remarkable that each one of these sug- 
gestions and recommendations was ac- 
cepted. An exposition was organised 
immediately in the winter of 1985. For 
many people this was the first occasion to 
become aware of CAL activities at the uni- 
versity and many of those working with 
CAL became aware of the others for the 
first time. Out-of-hours computing facili- 
ties for CAL were offered by adding spe- 
cific machines to the microcomputer labo- 
ratory in the Computing Services Building. 
The appointments of an educational ad- 
viser and a programmer were approved. 
The working party became a permanent 
sub-committee which now makes recom- 
mendations on all applications relating to 
computer support for CAL. Because it was 
considered impossible for the sub-commit- 
tee to address all educational uses of the 
computer, it decided at an early stage to 
concentrate on one specific application: 
Computer Assisted Learning. 

Establishment of Advisory Services 

In the winter of 1986 the two CAL advisers 
commenced work, one in the educational 
area attached to the Higher Education 
Development Centre and one in the techni- 

ERLC 



cal area attached to the Computing Serv- 
ices Centre. The major objectives, identi- 
fied by the CAL subcommittee, were: 

• fostering of communication between 
departments with an interest in CAL 

• ensuring the educational soundness of 
the design of CAL applications 

• encouraging the efficiency of software 
design 

Fostering of communication 

In the early stages many departments or 
solitary persons in a department had 
worked in isolation without being aware of 
what others were doing. The first CAL 
exposition in 1985 soon made it clear that in 
some cases efforts had been duplicated, 
been needlessly laborious or that some 
people had been 'reinventing the wheel'. 

To overcome this problem it was decided to 
form a "Software Society". This group 
meets several times a year to discuss areas 
of CAL use, design and development. 
Meetings may consist of demonstrations, 
presentations, discussion or the exchange 
of technical (programming) information. 
Seminars and lectures publicised among 
the wider university community, aimed 
both at regular users of CAL and at those 
people who are still in the information 
gathering stage, are also given several 
times a year. 

The consultant/programmer attached to 
the Computing Services Centre acts as a 
central advisory service and clearing house 
of CAL related activities and information. 
Anyone seeking information or advice 
regarding CAL will in the first instance 
contact one of the advisers. Depending on 
the stage of development, it will be thelask 
of either the educational adviser or of the 
programmer (and sometimes of both) to 
keep in touch with and offer assistance to 
the department in question. 

403 
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Educational soundness ofCAL applications 

It is primarily the task of the educationalist 
to advise people on the educational impli- 
cations of CAL, on the effects it may have 
on the curriculum, on the various ways 
CAL could be approached educationally, 
on the educational aspects of software 
design and on the evaluation of CAL use. 
Where a department is contemplating or 
planning the introduction of CAL for the 
first time, the educationalist and the pro- 
gramming consultant will work together 
with representatives of the department, 
locate and evaluate or design and program 
the software to be used, offer advice on the 
financial implications, where feasible set 
up a pilot study and evaluate the project. 

More efficient software design 

The earliest programs used in CAL were 
often programmed locally by the teaching 
staff, generally written in BASIC, usually 
run on the Apple II computer. In most 
cases, those involved with the program- 
ming felt that the task was too time con- 
suming and too distracting from teaching 
and research. It was hoped that the ap- 
pointment of a professional programmer 
would make it possible to develop more 
software more efficiently. 

The results, a year later, may in some ways 
be considered extremely encouraging, in 
other ways disappointing. In 1987 there are 
nine more departments using CAL exer- 
cises. However, seven of these almost ex- 
clusively use simple drill and practice exer- 
cises. There are some very specific reasons 
for this: 

• software design: a time consuming task. 
Tne most vital part of the development 
of a CAL application is the design of the 
software and the integration of the use 
of it in the curriculum. This is a task that 
has to be performed by the teaching 
staff, even though the programming 



itself does no t have to be. As a resul i less 
software has been developed than had 
been hoped, because the time and effort 
required from the staff was not avail- 
able or was not seen to be sufficiently 
worthwhile. 

• one-off applications: are they cost effec- 
tive? People are becoming more aware 
of the costs involved in CAL, both in 
hardware and in person time. Since the 
benefits are only rarely or sporadically 
evaluated, it ishard to justify the invest- 
ment. On a personal level, teaching staff 
can always be assured of the results of 
time invested in research, not of time 
invested in unevaluated attempts to 
improve teaching. 

• The Macintosh: a friendly machine, but 
difficult to program. Since its appear- 
ance, the Macintosh has been seen as an 
ideal computer foi CAL and at Otago 
theuseof this computer in the CAL area 
is overtaking the use of others. In the 
next section we will look at the reasons 
for this and the consequences for the 
CAL programmer. 

Growing popularity of the Macintosh 
computer 

The main reason for the great popularity of 
the Macintosh lies in the very carefully 
designed user interface: "The Macintosh is 
designed to appear to an audience of 
nonprogrammers, including people who 
have previously feared and distrusted 
computers/ 7 (from The Macintosh User 
Interface Guidelines, Inside Macintosh, 
page 1-27). In general, developers of Macin- 
tosh programs follow the guidelines given 

Hv ArtrVIo ftnH tho raciilf ic /wncic+cmsnr en 
~j ' ~ri // ~~ 

that users do not have to learn a completely 
new interface for each application. The 
learning time for using the Macintosh is 
very brief, some say non-existent, and this 
: s particularly important in CAL were large 
numbers of mostly naive computer users 
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have to become familiar with a program 
they may use only two or three times. 

However, the Macintosh is considered one 
of the hardest machines to program and 
even for an experienced person, learning 
how to program 'the Macintosh wa/ may 
take three months or more, assuming one is 
already fully conversant with program- 
ming itself. This fact does not add to the 
cost effectivenessoreaseof developmentof 
CAL programs! At present four depart- 
ments are developing applications for the 
Macintosh and Macintosh expertise is 
gradually building up. 

On the plus side is the fact that in the United 
States the Macintosh has been adopted by 
many universities as the ideal machine for 
use with students and a steady trickle of 
software suitable for CAL purposes has 
resulted from it. At the same time an in- 
creasing number of very imaginative pro- 
grams is becoming available, which are 
suitable for use as authoring or software 
tools for CAL units. 

Another approach, and one followed con- 
sistently by the Mathematics Department, 
is to use standard modules and to develop 
3ful modules and development tools 
first, as building blocks for later specific 
developments. A modular programming 
language such as u ascal is most suitable to 
such an approach and since Pascal is the 
'native language' of the Macintosh, mod- 
ules are developed in that language. A 
large range of modules, some most specifi- 
cally useful for mathematical manipula- 
tion, has now been developed. 

The present situation 
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CAL programmer/consultant has spent 
less time actually writing application pro- 
grams and more time trying lo locate and 
encourage the use of existing CAL pro- 
grams, software development tools and 
more efficient design methods. 
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One of the problems wiih existing, . ady- 
made programs is that they are seldom just 
right. The most often heard comment is: 
"Yes, it is a really nice program, but.... and 
if only../'. For this reason the most effective 
programs are authoring languages or au- 
thoring tools. Since authoring languages 
are the easiest to use and require the least 
input from the teaching staff (sometimes 
nothing more is done than the typing in of 
old exam questions by a typist!) they tend 
to be a first choice. 

However, more and more suitable soft- 
ware tools are coming on the market and 
potential CAL users are becoming more 
aware of the possible uses of tools such as 
spreadsheets, data bases, modellers. Com- 
ments have been heard from one or two 
departments, which at present mainly use 
the computer for drill exercises, that the 
limitations of drill exercises are becoming 
irksome. Now being totally familiar with 
the computer and some of its potential, 
there is a strong tendency to branch out. 
Three or four departments are using 
spreadsheets on the Macintosh (Excell, 
Multiplan, Jazz) for CAL exercises and 
more departments are at present experi- 
menting. The program STELLA, a model- 
ling program for the Macintosh, has been 
slow in taking off, but is generating a grow- 
ing interest as a simulation and modelling 
tool. Animation and pictorial databases are 
other directions currently under investiga- 
tion. 

There is a policy to buy software suitable 
for CAL centrally, so that it can be evalu- 
ated by the CAL advisers. Generally, new 
programs are announced in the Comput- 
ing Services Centre Newsletter, so that 
departments may request demonstrations 
or a loan of the program for evaluation 
before deciding to buy it. Those known to 
be interested in a certain program are per- 
sonally contacted. In general there is an 
atmosphere of cooperation and informa- 
tion sharing and the result is that efforts are 
less likely to be duplicated. 
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The educational adviser has lectured and 
given workshops on the educational impli- 
cations of CAL He has been encouraging 
the careful planning of projects, the use of 
pilot studies and evaluation of the exercise, 
using recognised research methods, thus 
making it possible to publish the results 
and to consider this work part of ongoing 
research. The underlying objective of 
course is to evaluate and possibly improve 
the effectiveness of CAL and its overall 
place in the curriculum. 

It is becoming harder to define CAL, as 
people become more familiar with the use 
of microcomputers as tools in everyday 
activities. When is the user learning and 
when is the user merely addressing the 
computer as a tool? The CAL sub-commit- 
tee may in future be less able to pin down 
CAL and be compelled to broaden its crite- 
ria. It has been suggested to refrain from 
using the abbreviation CAL, and rather 
refer to "the use of computers in teaching 
and learning": UCTL. Quite a mouthful 
and it has not as yet replaced the easier term 
CAL. 

Some future directions 

CAL has sometimes during its history been 
seen as a time saver, a personnel saver, a 
panacea, or simply the bandwagon to get 
on as fast as possible. Although occasion- 
ally such thoughts do seem to be enter- 
tained by some of those showing an interest 
in CAL at Otago, the centralized and struc- 
tured approach to CAL usually manages to 
identify and to dispel them. The growing 
interest in CAL is therefore in general ac- 
companied by a careful consideration of all 
the factors involved, educational, technical 

mi ici iiiiaiiCldi. 

The last factor especially will be the decid- 
ing one in whether or not the current trend 
of a steady growth in the number of depart- 
ments using CAL will continue. There is a 
tendency to develop and evaluate CAL 
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with small groups at first, often second or 
third year students, and then to gradually 
extend the use of CAL, as it is found effec- 
tive, to the larger classes. The logistics of 
this will have to be carefully thought out: 
whether it is feasible to accommodate large 
enough computer laboratories in each 
department using CAL or whether large 
public access laboratories, possibly net- 
worked and requiring management, might 
be needed. This question of access to hard- 
ware effectively forms the ceiling of future 
growth in CAL. 

Some developments that are expected in 
the near future and some of the investiga- 
tions currently going on: 

• It is expected that more departments 
will turn away from authoring lan- 
guages and drill exercises and that the 
use of 'application building programs' ( 
such as spreadsheets, modelling pro- 
grams, animation, hypertext, data 
bases) will increase. 

• The University will be investigating the 
use of Interactive Videodisc in CAL. 
Funds have been set aside for this pur- 
pose. 

• An area of lesearch is the use of Soft- 
ware Engineering techniques for the 
design and development of software. 

• Discussions are going on for the estab- 
lishment of a pilot study for the use of a 
set of computer writing tools for an 
English writing skills course 

• Because of the benefits seen in a central 
point of information it is eon sidled 
important to set up a national contact 
group for ter tiary CAL in New Zealand. 

Summary 

In the early days of CAL at the University of 
Otago departments were working in isola- 
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tion, often on an ad hoc basis. Most pro- 
grams were developed locally, written in 
BASIC for the Applell. Becauseof a central- 
ized approach, starting off with a univer- 
sity wide investigation and followed by 
both financial and advisory assistance to 
departments wishing to use or develop 
CAL, the interest in CAL has increased 
steadily and the approach to CAL has 
matured, become more structured. 

The three levels of support recommended 
by the CAL subcommittee have been oper- 
ating successfully: initial advise and analy- 
sis of the needs followed by allocation of a 
development machine together with pro- 
gramming and educational advice and 
assistance and finally making available a 
set of microcomputers, allowing the intro- 
duction of class use. 

The writing of stand-alone applications has 
decreased. The use of ready made pro- 
grams or programming tools has in- 
creased. The approach to programming 
has become a modular one and Pascal is the 
main language used. The use of Software 
Engineering methods in program develop- 
ment is an area of research Gradually the 
Macintosh ™ is becoming the preferred 
CAL machine, because of its 'user friendli- 
ness'. 

A department contemplating the use of 
CAL is carefully accompanied in its inves- 
tigations with advice. Where possible a 
pilot study is set up and increasingly the 
introduction of CAL will be evaluated and 
the results used to improve the effective- 
ness and the appropriateness of it in the 
overall curriculum structure. 
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A Computer Based Testing and 
Evaluation System 



Bill Chia: Computer Centre 

and Mon Khamis: School of Education 

Nepean College of Advanced Education 



The Design and delivery of many Tertiary 
Education courses are based predominantly on 
traditional presentation methods using lec- 
tures, seminars tutorials and reading materials. 
However, there are other techniques available 
to support these courses. 

A computer based testing and evaluation sys- 
tem has been developed on models which can 
incorporate techniques such as diagnostic feed- 
back, decentralised learning, self testing, moni- 
toring or progress and mastery learning. The 
system can provide reports to support sum ma- 
tive evaluation, test analysis and item analysis. 
Furthermore, the data can be presented in a 
form that supports ongoing formative evalu- 
ation of the course on which th«* test is a part. 

The approach adopted in developing this com- 
puter bases system has been to make it straight- 
forward and powerful enough to be used by 
teaching staff who may have Llmitod experience 
with computers, yet sufficiently general and 
flexible to meet the needs of different subject 
areas or different teacher's goals. Within the 
confines of the system, the individual student 
can be given some degree of control. The system 
can be adjusted to give guidance to tho student 
on the basis of performance. It may readily be 
expanded to allow other facilities to be incorpo- 
rated. 

The system was developed with the aid of the 
PLANIT authoring language and has been 
applied to subjects in the Schools of Business, 
Nursing and Health Studies, and Education. 
The paper describes the system and its applica- 
tion to a course in Research Methods in the 
School of Education atNep6^r C A E Tmnli ra- 
tions for the design of courses at the Tertiary 
level are discussed 



Many Tertiary Education courses are based 
predominantly on traditional presentation 
methods using lectures, seminars tutorials 
and reading materials despite the fact that 
there are other techniques available which 



could support and enhance the teaching of 
these courses. Computer based systems are 
one of the possible range of techniques. 

Over the last few years, there has been 
considerable discussion and consideration 
given to methods of development of 
computer based teaching and learning 
materials. Some have argued for retaining 
the flexibility of General Purpose computer 
languages such as Pascal, while others 
have pointed to advantages of specialised 
authoring languages. Yet it has also been 
pointed out that even the authoring lan- 
guages provide too little in the way of 
higher level constructs (Merrill 1985). 
Authoring languages may be valuable to 
authors if they lack programming skills 
and have too little time to gain therrt Sys- 
tems involving higher level constructs 
would be helpful to them and to any who 
have limited experience in instructional 
design. 

Authoring systems, as distinct from au- 
thoring languages, may provide some 
suitable models, though they are often only 
available on specialised hardware. The 
majority of academics in tertiary education 
are likely to find that their needs aren't met 
very well by the materials they can readily 
obtain. Commonly, the materials differ in 
emphasis from that desired and often re- 
quire a par ticular brand of hardware which 
may no t be available and cannot be justified 
on the basis of needs of one part of one 
course. Most would be daunted by the 
prospect of doing their own programming 
and would not have the time anyway. 
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At Nepean C. A.E. a system has been devel- 
oped around an existing Authoring Pack- 
age (PLANTR to provide simple-to-use 
computer based assessment and evalu- 
ation. The resultant system has a number 
of the features that a range of academic staff 
would find useful. With these features they 
can get the benefits of several types of 
computer based testing without the need 
to learn a programming language or an 
authoring language. 

The system makes use of options which can 
be selected by the Academic user and 
applied to their own course materials. The 
individual ideas in the system are rela- 
tively simple, but they help to bridge the 
gap between what a lecturer may wish to 
achieve with the aid of computer, and the 
level of practical programming knowledge 
or skills which he or she may currently 
possess. This system allows easy develop- 
ment of some computer based assessment 
and evaluation procedures for enhancing 
learning. It can be used as part of ongoing 
assessment or for final assessment. 

Lack of programming skills may be one 
reason that academics might avoid com- 
puter based support for their students. 
Limited knowledge of instructional strate- 
gies and instructional design may be an- 
other. The system we have developed al- 
lows the combination of various optional 
features to produce a number of coherent 
testing models. The options may be set 
specifically or patterns of options may be 
accepted by default. The user interface is a 
set of menus which feed the information 
through a 'preprocessor' to generate 
PLANIT Language lesson code'. This les- 
son code is quite quite easy to understand 
and can, if desired, be modified through a 
standard editor or through the PLANIT 
System itself. The lessons, however, usu- 
ally run satisfactorily without modifica- 
tion. In this way, the power of 'high level 
decisions' is readily combined with the 
flexibility of low level' detailed adjust- 
ments. 



The system has been applied to a range of 
subject areas. It has been used for Behav- 
ioural Science, Management Studies and 
Auditing in the School of Business; Meas- 
urement and Evaluation, Research Meth- 
ods, Educational Psychology in the School 
of Education; Human Growth & Develop- 
ment and Behavioural & Social Science in 
the School of Nursing and Health Studies. 
A set of tests in biological science are cur- 
rently being developed. 

Description of the System. 

Test items, in the form of multiple choice 
questions, are gathered and arranged into 
groups on the basis of subject matter, diffi- 
culty level or some other criteria. Ther 
questions become thebasisof a kind of "on- 
line" test bank. From this bank of items, 
questions are selected according to a pat- 
tern as decided upon by the academic user. 
The items are made available to the student 
via a centralised computer. The student 
can take the test at his or her own time 
(within a predetermined period, at selected 
times as decided by the academic). The 
academic can retain much of the control, or 
make it available to the student as he or she 
thinks fit. Options such as "immediate 
feedback", "progress reports", " printed 
report or certificate" can be decided upon 
by the academic. A most important aspect 
associated with assessment and reporting 
relates to its use for "measurement of prog- 
ress" and "mastery of contenf'.The advan- 
tages which are available to foster and 
enhance learning can often be lost or re- 
duced because of the difficulties of provid- 
ing the appropriate feedback and guidance 
to ihe btudent. By means of the system 
reported here, tracking of student re- 
sponses and performance data within the 
various subject matter areas or various 
difficulty levels can be made available on 
request. Results for an overall test or group 
of tests is gathered automatically and can 
be retained or discarded, as the academic 
may require. 
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How to use the system 

The academic users carry out the following 
steps. 

1 . Provide the questions, together with an 
indicator for the accepted answer or 
answers. 

2. Group the questions by subject matter 
areas, difficulty levels, educational ob- 
jectives, or other criteria. 

3. Decide what testing model and options 
are to be utilised, and what access is to 
be made available to the students. 

4. Decide what reporting functions are to 
be carried out when and if required. 

5. Trial the resultant test 

6. Inform (he students of the tesfs availa- 
bility, any special conditions, and how 
to access it. 

7. Obtain reports and use accordingly. 
Services Provided 

The services provided for the academic are: 

• Data entry of the 'raw' question items. 

• Conversion to PLANIT Language for- 
mats 

• Delivery of the test to the student. 

• Gathering cf report data 

• Reports to the student: this includes 
progress reports, end-of-test reports 
and summarised results. 

• Reports to the lecturer: This includes 
detailed reports (if required) and re- 
ports summarised by class, by topic or 
by course. 
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Of the above, the data entry is provided by 
the Computer Centre staff; the rest is pro- 
vided by the system. 

Application of the system to an Educa- 
tional Research Methods Course 

Formative and summative methods have 
been used to assess teacher education stu- 
dents in an educational research methods 
course. Traditionally, the formative exer- 
cises comprised of workshop reports and a 
major assignment. The summative proce- 
dure was an end of semester exam. Thesa 
evaluation procedures did not provide 
students with appropriate motivation, and 
the r^essary feedback on performance to 
plan ongoing study strategies to master the 
course content. The students have viewed 
these procedures as major obstacles to be 
overcome at certain times in the semester 
and did not provide a positive structure for 
the average students to assess their level of 
performance and plan study activities to 
compensate for deficient areas of knowl- 
edge. 

Certa ; n features of the computer basei 
evaluation system were used to develop a 
formative assessment exercise to overco T ae 
some of the criticisms of the tradi^'jnal 
class tests and to provide students with an 
opportunity to obtain feedback in a non 
threatening environment. This feedback 
allowed them to identify areas of course 
content they were familiar with and other 
areas needing further study, 

Structure of the class test 

The educational research methods test 
contained a bank of 50 multiple choice 
items with four possible options for each 
item. The items were grouped into five 
areas. The students completed 25 ques- 
tions randomly chosen from the 50 item 
bank as follows: 
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1) nature of educational research 

8 questions - 4 chosen 

2) hypothes testing 

10 questions - 5 chosen 

3) data collecting procedures 

14 questions - 8 chosen 

4) scaling procedures 

7 questions - 3 chosen 

5) interpreting statistics 

11 questions - 5 chosen 

The correct response for each question was 
incorporated into the system in order to 
provide the student with feedback on test 
performance. The students obtained an 
analysis containing the total number of 
questions attempted, the number of cor- 
rect, and incorrect answers and their re- 
spective percentages. 

The students attempted each question 
chosen once. They were not permitted to 
choose another option if their first choice 
was incorrect. However, this would be a 
useful option within the tesc structure. 
Students could have a second attempt, and 
if this was incorrect then the correctoption 
would be given. 

The time element was not considered a 
major factor in the development of this 
class test. Students had two minutes f.o 
respond to each of the 25 items chosen. 
However, the time element can be useful 
learning stimulant, and can be adjusted 
according to the number of attempts made 
by each student or students can be given an 
opportunity to adjust the response time to 
suit themselves. 

The item bank of 50 questions was very 
limited. This could be substantially in- 
creased in order to test content areas more 
exhaustively, particularly if students at- 
tempt the test several times. An available 
feature which was not incorporated into 
the test is the analysis of scores for each 
section of the test and the provision of 
feedback on performance in each area. The 
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studentcan then be directed to read certain 
chapters of the text relating to the items the 
student got wrong. 

The level of mastery was not ino >rporated 
into the test. A useful feature would be to 
set a mastery level of say 75%. If the student 
did not achieve this then he would be di- 
rected to learn certain areas of content be- 
fore retaking the test. 

The diagnostic procedures are useful to 
students and course presenters. If certain 
items were causing difficulty to students 
then the concepts associated with these 
items need further reinforcement and clari- 
fication. Lecturers can ascertain certain 
areas of knowledge which cause students 
more difficulty and plan the course to cope 
with this. 

The non threatening environment can be a 
major motivating factor in student learn- 
ing. If students are given the opportunity 
to undertake the test a number of times 
until they have achieved a certain level of 
performance then they are more likely to 
continue to learn because no judgment is 
made on their performance by the lecturer 
or the*/ peers. A further modification of the 
mastery process may include a barrier for 
each section of the test. The studen s must 
achieve a fixed mastery level in each sec- 
tion of the test prior to any new items being 
presented. 

The options can be included in the system 
so that if certain questions containing basic 
concepts were correct then extension ques- 
tions could be presented. Unless this oc- 
curred then no new questions would be 
pr sented and the student wouid be in- 
structed to study sections of thp * ct prior to 
retaking the test. 

These options allow the student to practice 
exam strategy and identify strengths and 
weakness. The student would develop an 
overall strategy to sit for the final exam. 

$11 
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The course could be modified to reduce Jie 
impact and the threat of summative evalu- 
ation and cha nge the orientation to infor- 
mative eva' .Hon. The options available 
in Plan should be used to allow the 
student three attempts within a given pe- 
riod of time. The results of the th-*c at- 
tempts could be aggregated and converted 
into a final score for the summative evalu- 
ation. The benefits which could accrue 
from this procedure relate to the conver- 
sion of short term memory to long term 
memory . S txxdev ts are yore likely to recall 
information if they have an opportunity to 
learn it for mastery and understanding 
r«iher than recall. This could be achieved 
by modifying the test structure to change 
the correct option for each item. This may 
prevent the student recording the question 
and its correct response, and force the stu- 
dent to develop an understanding of the 
concepts associated with each question 
instead of recalling factual responses. 



Appendix: Models and Options 

There are a number of models which have 
established their usefulness. These form 
some of the components available for use 
within a course. 

• MASTERY LEARNING 

FORMATIVE AND SUMMATIVE 
ASSESSMENT 

• DIAGNOSTIC FEEDBACK 

• STUDENT CONTROL 

• SELF TESTING 

• MONITORING AND ADVISING 
REPORTING ON THE BASIS OF 

CONTENT, DIFFICULTY, INDIVID- 
UAL, CLASS and COURSE. 

The facilities which have been made avail- 
able may be thought of as TOOLS for con- 
structing models. There are available in the 
form of OPTIONS which allow specific 
setting of various alternatives to suit the 
teacher or learner's particular goals. The 



options may be used for the assessment 
system or for tes*-cum-tutorials wnich 
provide some extended support material. 
Some of these OPTIONS are available i 
teractively from a menu, others are pro 
vided by making a few adjustments to the 
lesson file. Options currently available or 
proposed, are set out below. 

OPTION: Feedback or none 

DESCRIPTION: Right-Wrong feedback , 
with or without Answer Correction , 
with or without Answer EXPLANA- 
TION for some or all questions, 
with or without Specific Feedback on 
particular answer chosen, 
with or without Branching (increases 
complexity). 

OPTION: Immediate Retry 
DESCRIPTION: variations are: 

Notallo^'M, permitted, or forced (I, 

2, 3 or more times) 
POSSIBLE USES: Tesb, Self Tests, Mastery 

OPTION: Time Limit (on or none) 
DESCRIPTION: Maximum time allowed 

per question. May be 

set by author 

set by student (if permitted by author) 
set by lesson performance 

OPTION: Random Order Presentation. 
DESCRIPTION: The questions may be 

presented in random order. 

They can also be randomly selected 

from defined subgroups of questions. 

The number to be chosen from each 

subgroup can be set by the author. 
POSSIBLE USES: Generate a different test 

for each student. 
The choice could be set by the studen t or by 

lesson performance criteria. 

OPTION: Progress Function. 
DESCRIPTION: Gives a summary of 

student's progress: (No. seen, right, 

wrong, percentages). 

During and after test, or at end only 

(author's choice). 
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POSSIBLE USES: Extend to give advice to 
the student. Advice may be based on 
subcategories of questions such as 
content, specific objectives, difficulty 
etc* 

SUITABILITY: Tutorials or self test 
EXAMPLES, RATIONALE: Guide or moti- 
vator 

OPTION: Finish at any point 
DESCRIPTION: Available at the option of 

the author. Can also specify, resume at 

the same point or resume at the start, or 

specified points only, 
POSSIBLE USES Allow or withold student 

control. Depends on material 

OPTION: Retake the test 

DESCRIPTION: Immediately or after a 
given period (unlimited or restricted 
number of times, or disallowed) 

POSSIBLE USES: Self Test or mastery test- 
ing or assessment 

SUITABILITY . EXAMPLES, RATIONALE : 
Student control, or not? 

OPTION:Printed Certificate or Report. 

DESCRIPTION: Prints a Certificate or 
Report if preset score or percentage 
ranges are attained. 

POSSIBLE USES: Extension to give sub- 
group scores. 

SUITABILITY, EXAMPLES, RATIONALE: 
Mastery, self test goal setting and 
"reward". 

Provide written advice to student. 

OPTION: Punching and Return. 

DESCRIPTION: Branch to sections which 
can be selected interactively. 

POSSIBLE USES: This allows review or 
preview of test material. It can also be 
used to provide supplementary infor- 
mation, Hints, Data, Worked examples, 
context sensitive advice or help. 

OPTION: Branching (No automatic re- 
turn). 

DESCRIPTION: Thisallowsbranching to a 
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(sub)section or around a (sub)section. It 
may be placed under author control, 
student control or student performance 
control. 

POSSIBLE USES: Remedial or fast track. 

COMBINATION OF OPTIONS: Options 
may be combined to produce particular 
environments for learning. 

e.g. GROUPING BY DIFFICULTY, PROC- 
ESS 

e.g. GROUPING BY CONTENT, ... RE- 
PORTING. 
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Success in CAI (Computer Assisted Instruc- 
tion) depends on the use of appropriate tech- 
nology, the selection of suitable material for 
presentation and management which aliov/s 
adequate student access to courseware. The 
Biochemistry Department at Adelaide Univer- 
sity has been using CAI for a decade with 
gratifying results while spanning 3 generations 
of personal computers. The present Biochemis- 
try Department facility of ten Olivetti M24 
personal computers is able to serve the course 
revision requirements of over 300 students 
who use the facility voluntarily. The principal 
teaching tool is the "Q" Instruction Package 
serviced by a data base of some 9000 questions 
(the Medical Biochemistry Question Bank). At 
the pioneering forefront, optimistic predic- 
tions can be made for videodisc applications 
and the authors will discuss their involvement 
in the production and application of the first 
Australian University videodisc. 



The reason that CAI deserves seriousatten- 
tion is that it is a medium which reaches a 
majority of students in a manner that is 
different from other teaching contacts and 
technologies. Saving teaching money or 
liberating staff time are not valid argu- 
ments in support of CAI. As with other 
teaching approaches, the essential ingredi- 
ent for success is a belief that CAI has a 
valuable contribution to make. Education 
specialists look for absolute evidence of 
pedagogic value, but the case is very much 
that you will get out of CAI what you 
believe you will. 

In the oral presentation we will illustrate 
our views by reference to the hardware and 
software we have been associated with. We 
will speculate on the applications for new 



generation mass storage devices, particu- 
larly in regard to video images. 

What do we learn from technology ex- 
tinction? 

Technology which is fated to survive is 
responsive to individual interaction and 
powerful enough to perform truly useful 
tasks. 

Novelty is an undoubted component of 
short-term success. Sputnik aroused amaz- 
ing interest, although it was almost func- 
tionless. It is difficult in the early days of a 
technology to decide whether state of the 
art technology is mature or simply a por- 
tent of truly practical machines to come. 
The authors are of the view that contempo- 
rary personal computers and video disc 
technology will continue to contribute to 
useful teaching. 

In the early 70s colleagues at Melbourne 
University Biochemistry Department 
documented the successes of their on-line 
facility for undergraduates to use a tele- 
printer terminal to analyses enzyme kinet- 
ics. In the Adelaide Biochemistry Depart- 
men' Sinclair ZX-80 in the late 70s fasci- 
nated students who saw it translate genetic 
code sequences into protein structures, all 
in 4K of RAM. The idea of using this equip- 
ment today is laughable, but it does illus- 
trate the motivational value of using what 
is perceived as state of the art hardware. 
Novelty in these cases obscured long-term 
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utility. 

Those of us who rode in on the pioneering 
wave of personal computers in the late 70s 
and early 80s thought that Apple lis, 
Commodore PETs and BBC microcompu- 
ters would perform each and every educa- 
tional task capable of imagination. It has 
not proved to be so, the 8 bit computers of 
the early eighties have been relegated to 
the status of transanal technology. The 
pioneer personal computers set new stan- 
dards for user friendliness however, and 
this has been their legacy to present genera- 
tion computers. 

The teaching suite of Dr.Robert Beynon 
(Liverpool Biochemistry) has built an envi- 
able international reputation for CAI using 
Commodore PETs and Apple lis. This 
work has been negated completely by 
changing to a network of contemporary 
MS-DOS computers - an entirely new 
teaching software base is being created. 
This story mirrors the demise of Exidy 
Sorcerer computers in the Biochemistry 
Department at Adelaide University. 



Which aspects of teaching technology 
can survive the hype of immature 
expectation? 

The large scale funding of unsuitable tech- 
nology has done long term damage to 
general funding prospects for teaching. 
The flirtation with educational television is 
a)\ but dead. Television monitors droop 
dustilly towards disinterested audiences in 
lecture theatres and teachir ^ .uooratories 
around the world (many of them still Black 
and White). Mass oriented educational 
television lacks the ability to cater for the 
pace at which an audience is responding to 
the message and has suffered accordingly. 
An apparent success in the use of television 
is the real- time link between London Medi- 
cal Schools for teaching in which multiple 
screens and camera options are used in a 
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"tele-conferencing arrangement". This 
perceived need for some aspect of one-to 
oneness is epitomized by disastrous at- 
tempts to use shared listening stations of 
six head-phones linked to a single cassette 
player in the Biochemistry Department at 
Adelaide. This head-phone share arrange- 
ment was a solution to the then high cost of 
the technology, and encouraged by the 
enticing glossy from the manufacturer 
showing happy students in an atnosphere 
of mutual learning ecstasy. 

The tape-slide teaching facility in the Ade- 
laide Biochemistry Department is a survi- 
vor of technological approaches to educa- 
tion. It still fulfils a valuable role in non- 
lecture teaching because tapes, with ac- 
companying written handouts, can impart 
a higher density of new information than 
computer screens. The cassette players 
used for teaching no longer represent nov- 
elty in technology, but an everyday ma- 
chine. 

The elements of cassette tape which com- 
mend it include 

• one standard - a cassette tape can be 
shared internationally 

• it is personal - cheap enough for 1 tape 
player per person. 

• it is unintimidating in its controls. 

Computers have not reached this degree of 
establishment and are therefore duly re- 
garded with scepticism for educational 
applications. The wait and see approach 
however is self defeating - the time to enter 
the learning curve for computer applica- 
tions is now when computer technology is 
reasonably affordable and adequately 
powerful. 

How powerful do educational micro- 
computers need to he? 

Computer power is not a real issue. The 
essential question is "will the computer 
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allow me to extend my teaching at a level 
which is satisfactory for my courses." Tech- 
nical capabilities of the machinery are in- 
creasing logarithmically, but our educa- 
tional requirements are not. We now have 
affordable machines that have adequate 
speed, memory and physical compactness 
to be useful. 

Contemporary powerful computers (main 
frames) are not an answer to any real edu- 
cational problems in our experience be- 
cause they are made by computer-in 
people for other computer-in people. Pow- 
erful computers are usually expensive and 
begrudgingly available from their manag- 
ers. For students big computers mean rigid 
scheduling and limited time of access. An 
intimidating Big-Brother log-on procedure 
then exasperating delays. If a student 
spends ten minutes pondering the truth of 
a statement, the expectation is nonethe- 
less that the computer will respond in- 
stantly when a key is pressed. For teachers 



there is the need to cither master difficult 
authoring software or master the technical 
resource people who have. 

Not powerful enough is disastrous 
too. 

The UK has retarded its development of 
CAI by so whole-heartedly adopting the 
BBC micro. Nigel Gardner of the Comput- 
ers in Teaching Initiative (CTI) in the UK 
has succinctly argued this case and it is a 
compelling conclusion. The grounds for 
this are technical and human. Technically 
the BBC computer is, in its most common 
configuration, incapable of more than sim- 
plistic modelling and shallow gimicry. The 
commitmentof funds has been so extensive 
that the coffers are bare for re-equipping 
with better technology. In Australia at 
least, funds have not been dissipated by 
any initiative of the Federal Government to 
introduce computers to education. 
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Figure 1 : A screen from a "Q" session computer tutorial to teach aspects of pH. Computer 
tuition on this subject exploits the ability of a computer to interact with students with 
unfailing patience and consistency. 
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How many students should work 
simultaneously at a station? 

Assuming voluntary self-paced usage it 
may be one, two or four. One user only per 
station is appropriate when the material is 
new or difficult, otherwise with multiple 
use the advantage of freedom from peer 
judgment is lost. Even the best of friends 
may not work well together at a computer 
if their talents are unequal Groups of four 
are quite successful for medical students 
taking revision questions together. Medi- 
cal students as a group have characteristi- 
cally high social cohesiveness plus aca- 
demic competitiveness and enjoy audi- 
ences to their performance (at least when 
they are scoring highly). This argues for 
keeping enough space between stations to 
allow people clusters to form (regrettably 
few places of learning are built with suit- 
able space). 

What material is best presented by 
computer? 

The mindlessly repetitive tasks of teaching 
are best suited. For example a tutorial on 
the Biochemical importance of pH at Ade- 
laide begins by asking: 

When pH is high, is H+ concentration 

1. High 

2. Low ? 

This low-brow question is insultingly basic 
when asked by a human tutor (despite the 
widespread ignorance of the answer). This 
computer tutorial then progresses through 
some elementary mathematics of impor- 
tant chemical principles. When human 
tutors attempt to explain these principles a 
predictable dull glaze clouds most stu- 
dents and learning ceases. The quality of 
effort of a human tutor teaching boring 
basics deteriorates with repetition, so the 
computer is noticeably superior. 



A successful recipe - Adelaide Biochem- 
istry 

Ten Olivetti M24 computers (IBM-PC 
compatible) have proved adequate to pro- 
videCAI for 300 undergraduates. Each unit 
has a colour screen and a 20Mb hard disk 
with courseware selected from a boot-up 
menu. Questions are available throughout 
each term relating to lecture coursework. 
The motivation to take the sessions derives 
from 

• relevance (the questions may be asked 
in an exam) 

• local authoring (Course lecturers are 
responsible for question generation or 
selection) 

• objective self -assessment of progress. 

Students can make their own time to use 
the CAI materials. This can be at times that 
are uncommitted or quiet time in a labora- 
tory period. 

The local generation of material is impor- 
tant, in part because it shows students that 
their teachers have made time to prepare 
the material. The exclusive use of third 
party courseware is courting disaster. The 
"Q" Instruction Package has been the basis 
for rapid generation of local material at 
Adelaide. The "Q" Package makes session 
authoring essentially an exercise in text 
preparation. 

Towards ultimate teaching technology 
with videodisc 

Colour enliv enb a computer screen because 
it can impart additional information such 
as separating factual information from 
question and answer segments of a text 
display. Graphics too can contribute to 
enlivening computer tutorials. It is in the 
area of graphics and animation however 
that the most atrocious misuses of CAI 
authors' time are committed. Figure-1 il- 
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Iustrates a graphic from the pH tutorial 
mentioned before which is adequate for the 
purpose intended and took relatively little 
time to draw with a mouse assisted graph- 
ics package. Graphics are in general a pat- 
ent failure of computer technology to ade- 
quately represent real objects statically or 
in animation. This is the role for videodiscs. 

Videodiscs contain a library of 55,000 static 
pictures in high resolution which can in- 
clude animated segments (like a video 
tape). The feature that sets videodisc apart 
from video tape is that each frame of infor- 
mation can be rapidly called under the 
control of a computer. Voila! you have it - 
the ultimate educational technology of the 
present day. The interactive intelligence of 
computers linked to high quality pictures 
stored on a videodisc. 

At Adelaide University we were fortunate 
to have accumulated a substantial resource 
of slides and film/video which we were 
able to transfer to video disk in 1986. This 
has been linked to the "Q" Instruction 
package for teaching in Obstetrics and 
Gynaecology and in Geology (figure 2). 



An application for teaching written-Chi- 
nese at Adelaide required a purpose writ- 
ten program. This application exhibits 
many of the good points of successful CAI 
with interactive videodisc and will be dis- 
cussed. 

Conclusion 

A successful CAI facility which is likely to 
survive pressures of obsolescence can be 
built from current microcomputers. The 
software must be clearly relevant to the 
course of instruction. Simplistic computer 
graphics are generally unsatisfactory, and 
interactive videodisc is the solution to in- 
teractive instruction involving detailed 
pictorials. 



o 
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RS232 cable 



Figure 2: Using the "Q" Instruction Package with videodisc is a rapid means 
of authoring. 
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For some time now, the development of CAL has 
been focussed on hardware, software, and course- 
ware. This paper shifts the attention momentarily 
to the users. Regardless of the sophistication of the 
technology, the long term success or failure of CAL 
depends on it being intelligently applied. Indeed 
people must choose whether the technology 
should be applied, and, if so, how and when- Just 
as the "intelligence" built into many new CAL 
systems does not happen by itself, people must be 
adequately informed and prepared if they are to 
exercise their judgment intelligently. 

The paper considers how this human resource 
might be developed, since the human "intelligent 
user" is better placed to seek new and innovative 
applications than is any currently extant computer 
program. 

Since the study of computer assisted learn- 
ing (CAL) began, research effort has 
centred on hardware, software, and 
courseware. Much of this research is de- 
rived from work in programmed learning, 
and training. More recently, systems for 
learning are derived from the study of arti- 
ficial intelligence (AI). 

So far, computers have not been pro- 
grammed to be particularly creative. They 
cannot yet make the quantum leap of 
understanding which leads to a new use for 
an existing tool. They cannot invent new 
tools to solve existing proems. Human 
users can. 

Thus more is needed than inanimate, even 
intelligent, technology if CAL is to be nur- 
tured and grow as a discipline. Intelligent 
users are at least as important as the tech- 
nology. It is the users who will ultimately 
determine a project's success - or failure. 
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The skill to use this new technology flu- 
ently does not come naturally or easily. It 
must be developed, and inspired. Once 
acquired in theory it must be practiced. 

People are Important 

The importance of people in the develop- 
ment of CAL is shown clearly in the litera- 
ture. A few examples, by no means iso- 
lated, may illustrate this. 

In an international study of factors influ- 
encing CAL development Hawkins (1977) 
reported that 'In all countries the over- 
whelming response was the importance of 
the initiative taken by one, or at most two to 
three project members. ... Most frequently 
commented on was the importance of an 
energetic, dedicated and knowledgeable 
central figure who could give leadership 
over the range of activities, and an enthusi- 
astic, cooperative group prepared to put in 
a strenuous work day over a long period of 
time/' 

Sprecher and Chambers (1980) studied 200 
CAL development sites. They observed: 
"They heavy development group was 
composed of faculty who placed a high 
value on CAI [Computer Aided Instruc- 
tion] and who perceived their department, 
their campus computer center, and the top 
administration of the campus as favour !ng 
it." 

The importance of giving users flexibility 
to adapt the system to their needs was part 

19 
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of the philosophy behind the development 
of Computer Managed Learning (CML) at 
the Southern Alberta Institute of Technol- 
ogy in the early ^CXs. Stephen (Distefano 
& Stephen, 1982), commented: 'The 
strength of the system [is] that it lets users 
be creative, and new applications and 
methods of use appear as users alapt the 
system to their particular needs/' This 
implies that the system, which has been 
successfully marketed throughout the 
world, was specifically designed to ac- 
knowledged that people must still exercise 
judgement on the use of the system. 

Ausburn (1982), reporting on a study tour 
of the US in which she investigated the 
training approach adopted by the US Air 
Force, also identified understanding and 
commitment displayed by administration 
and users as significant. She highlighted 
training as vital in establishing both under- 
standing and commitment. 

These examples serve to illustrate that 
committed and informed leadership is 
necessary for CAL to be made to work. 

They also suggest that developers and 
users must be informed if they are to be 
innovative in their use of CAL. Trai ning of 
some sort plays an important part in the 
development of the people who will imple- 
ment CAL. They are all positive examples. 

But there are also factors at work which 
contribute to resistance to the use of CAL. 
Zemke (1984) found that: "... one distin- 
guishing characteristic of the 'computer- 
phobe' cannot be explained away by our 
sample: He is absolutely to be found 
among the one in five trainers with nary a 
micro-computeratworkinhisdepartment. 
Not only has he virtually no experience 
with computers, he has never taken a CBT 
[Computer Based Training] course. In 
short, the compu ter reluctants in our midst 
are most easily distinguishable from the 
computer advocates by the single charac- 
teristic of inexperience." 



Clearly then it is important that potential 
users, not just the committed developers 
and enthusiastic leaders, must be given the 
opportunity and encouragement lo gain 
experience with CAL. 

But is it enough for the users to be trained or 
experienced in the intricacies of the hard- 
ware, software, or courseware? Probably 
not! 

The influence of the teacher is profound. 
Clark (1983) suggests that the positive 
achievement effects for media more or less 
disappear when the same instructor pro- 
duces all treatments. Hedberg and Char- 
lesworth (1981) suggested the same phe- 
nomenon. They observed "that the success 
of a media-based system in the class-room 
depended at least as much on the learning 
activities organised at the receiving end as 
on the content that went into the transmit- 
ting end." Clearly the teacher who is 
managinga learning program, and specify- 
ing alternative resources to meet technol- 
ogy in determining the effectiveness of the 
media in producing learning achievement. 
Thus any training or experience must in- 
clude consideration of the students who 
will use the system too. 

My own informal observations of students 
working with tutorial type CAL material 
suggest that students can quickly become 
bored or frustrated, frequently not com- 
pleting the set material, and if given the 
choice may not return to class. Kearsley 
and Hillelsohn (1982) support these obser- 
vations. This happens when the CAL de- 
signer didn't fully appreciate the diverse 
needs of student users. In many applica- 
tions of CAL this phenomenon is not visible 
because the students are motivated by 
some form of compulsion. Certainly then, 
it requires some understanding of the prob- 
lems of helping people to work with CAL 
learning resourcesif they are to be effective. 

Chorover (1984) echos an increasing view 
that: "It is only in the context of a suppor- 
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tive educational community - a human 
environment conducive to learning - that 
the hazards of automation [in education] 
can be avoided/' Inappropriate uses, or 
uses which lead to boredom or frustration 
in a learning context will be quickly reme- 
died by a teacher with experience using the 
medium. The teacher must decide if, or 
when, the tool should be used. People must 
dictate the use of the technology, not the 
technology drive the people. 

Even an expert ("intelligent") CAL, which 
has been specifically designed to capture 
the specialist expertise of both teachers and 
subject specialists, needs some user skill if 
it is to be effectively integrated into the 
learning environment. 

The question which is yet to be resolved is 
how best to provide this experience. 

Developing the Experience 

There are four ways in which the necessary 
experience base can be developed in a lay 
population: 

• Mongolian hordes approach; 

• Osmosis; 

• Formal courses; 

• Strong leadership. 

"Mongolian hordes'' approach 

Solving problems by original development 
has been mainly achieved by employing 
large numbers of people to work together 
at a solution. Coyne suggests the "Mongo- 
lian horde" approach, throwing large 
numbers of people at a problem, will 
probably be paid for ... with the worst skill 
shortage ever, and this shortage will be 
accompanied by escalations of salaries, 
dissipation of management effort in miti- 
gating the inaeased staff mobility, and a 
debilitating feeling of instability pervading 
the industiy ." The expectation is that given 
enough people working in an area exper- 



tise will develop and leadership will 
emerge. This is not always true. 

In 1980 the British Columbia (Canada) 
government contracted with a private 
company to develop CAL materials for 
local school divisions. This contract also 
included strategies for developing the skill 
of participating teachers. This project 
sought to involve teachers by offering five 
hundred dollar incentive grants to teachers 
who participated in courseware develop- 
ment. It hoped that by generating software 
in quantity, some quality software would 
emerge. This grant approach "produced 
no software of usable quality." In this 
example, the "Mongolian horde" approach 
did not work. 

A similar scheme was a major focus of the 
Australian government initiatives in com- 
puter education in secondary schools. 
While this initiative undoubtedly devel- 
oped the skill of many teachers, it barely 
scratched the surface of the need, and was 
discontinued last year after only two years 
in place. Other initiatives in New Zealand 
suffered the same fate/ It seems that now 
the same few faces who have always as- 
sumed a leadership role in secondary 
computing are continuing to do so. Again 
the "Mongolian horde" approach didn't 
work too well. 

The most successful implementation of the 
"Mongolian horde" strateg; is the con- 
certed effort in England to get two teachers 
with CAL experience into every secondary 
school in the country. These teachers were 
to be the nucleus of experience in the 
schools from whom others could learn. 
This program has taken many years to 
realise its goals, and has been expensive, 
but has demonstrated that a systematic 
training program to develop "grass roots" 
teacher'sskillscanwork. Buteven given its 
success, the program has shown that "a lot 
of the educational software [resulting from 
the program] is rubbish." 
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The "MongoKan hordes" strategy requires 
a great deal of money, and considerable 
commitment from the administration to 
support the development program until it 
can become self sustaining. The English 
experience shows that, because of the re- 
sulting increased awareness of CAL, users 
eventually became more discerning in their 
choice of suitable courseware, but it is a 
brute force strategy which does not system- 
atically strive to develop leadersor breadth 
of skill among users. 

Osmosis 

The English experience has shown that if 
there are enough people in the system with 
adequate skills in CAL, others will be en- 
couraged to seek the skill too. thus the 
experience of a few will flow through the 
system by osmosis. This strategy relies on 
sufficient skill being available for the expe- 
rience to be visible and clearly acceptable 
within the system. Without encourage- 
ment from administrators for people to 
undertake specialist courses, or without 
rewards for gaining the expertise some 
other way, there will not be enough com- 
mitted, experienced people to "seed" the 
osmosis process or to motivate the com- 
puter reluctants. 

Formal Courses 

Formal courses in CAL methods are the 
cornerstone of the successful English staff 
development programs in CAL methods. 
A major impediment to using formal 
courses to develop CAL expertise in terti- 
ary institutions is the commitment re- 
quired. Most academics are, quite rightly, 
committed to developing skills in their 
discipline or in administration. They have 
little time left, and are given little incentive, 
to develop specialist CAL skills. Thus aca- 
demicsare reluctant to undertake still more 
training than they already have, especially 
if it is outside their primary discipline. 
Despite this, formal courses still have a 
place. They can be concentrated and sys- 
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tematic resources for gaining the experi- 
ence quickly. In tertiary institutions which 
require teacher training, experiences with 
CAL could be included as a compuirory 
part of the course. In the more usual situ- 
ation where such coursesare optional, they 
still need to be available when users are 
sufficiently motivated. But the courses in 
themselves are usually not the motivation 
for formal trainings. 

Because of the reluctance to make use of 
formal courses, a people development 
strategy based on them will take a long time 
to reach most existing teachers. If the staff 
turnover is small, the time required to get 
the expertise to where it is needed may be 
unacceptable. 

Strong Leudership 

Clearly what is needed to excite teachers 
about the intelligent use of CAL, is strong, 
visible, and enthusiastic leadership. This 
must be two fold. 

First those who have made CAL their aca- 
demic speciality must display their suc- 
cesses to others through conferences like 
this one, in seminars, or even over coffee or 
lunch. These same experts must be able to 
discuss the problems likely to be encoun- 
tered by novices, and the relative merits of 
a range of possible solutions. Using this 
already established human resource in the 
institution as the seed from which the 
osmosis process can spread may mean that 
it is not necessary to present courses just to 
generate the initial experience. Rather, 
such visible examples might encourage the 
CAL reluctants to sample the formal 
courses and explore other learning re- 
sources for their own development. 

Second, administrations should recognise 
that the people who can provide the leader- 
ship already exist in their organi, ations. 
This resource must be nurtured. Adminis- 
trators need to provide the incentives, both 
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to keep the experts interested in pursuing 
their new discipline, and to provide the 
incentive for novices to emulate their more 
experienced colleagues. For this reason, 
successful work with CAL should be recog- 
nised as valid work for promotion and 
other rewards. 

The advantage for administrations in 
adopting a positive attitude to building on 
thepxistingcommitmentisconsiderable. It 
is not then necessary to generate a sea of 
novices in the hope that strong leadership, 
or even adequate experience, will emerge. 
The resource is already there. The commit- 
ment is already there, the ability to make 
thequantum leap leading to new and ixtno- 
vating uses for the technology is in place. 
All thatisneeded is the support to maintain 
and encourage the work and to encourage 
the spreading of the expertise to newcom- 
ers. 

Administrative Leadership 
Implications 

In a climate in which economic and politi- 
cal pressure to provide vocational prepara- 
tion and broad personal development at an 
increased level is being placed on acade- 
mia, and no less on industry, there is a 
strong incentive to look to technology as a 
savior. There are considerable economic 
advantages for looking to CAL to increase 
efficiency. But should this cause us to abro- 
gate our responsibility to people and put 
our faith and trust entirely in technology? I 
think not. 

We must put at least as much effort into 
developing the skills of people who will 
use the technology intelligently. People 
should be systematically encouraged to 
seek new and innovative uses for CAL. 
People are better able to do this than any 
extant computer program. People are the 
key to successful development and use of 
CAL. 
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The incentive to develop the necessary 
skills must come from the institutions if 
there is to be a significant development of 
existing staff to effectively apply CAL. For 
this skill base to be developed systemati- 
cally, strong leadership is essential. This 
leadership must be accompanied by users 
of CAL who are encouraged by example to 
improve their own skills. It is thes>e users 
who will eventually make CAL work. 
Administrations cannot expect that adopt- 
ing a "Mongolian horde" approach, or 
expecting the skills to develop by osmosis, 
will be effective without strong, effective 
leadership, backed up by formal training 
where necessary. 

Is it possible that, despite the intelligence 
built into the technological tools, the real 
intelligence in CAL needs to be first in the 
minds and hearts of the human users? 
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Computer-based training: Networking of autistic 

and other retarded students in sheltered training 
establishments 

R. A. Coldwell, information Technology Division 
Royal Melbourne Institute of Technology 



One of 'iie major problems concerning education 
of retarded people *n Australia is often their 
geographical isolation. Where they live in urban 
areas and, consequently/ facilities can be pro- 
vided for them. They can be given specialised 
training. Increasingly, we are finding that both 
autistic children and adults are having to be 
moved to these locations and, often, to institu- 
tions away from their parents. The writer argues 
that, given the use of existing technology, chil- 
dren can now be integrated into the populations 
ot their local schools and their teaching supple- 
mented by u*e of computer-based learning via 
communications networks or even by use of 
modem and telephone lines. This, in turn, en- 
ables them to become integrated into TAPE and 
other courses and, later, into sheltered work- 
shops which are computer-based. 



This isa workingpaper whichreports some 
of the difficulties with trying to break- 
down a few of the barriers that we set-up 
against using technology to bring educa- 
tion to tho^e who, for some reason, are not 
in a position to claim it for themselves (see 
Coldwell 1984), This may seem like a curi- 
ous statement to make in modern-day 
Australia but, nevertheless, it is valid. 
Ofte.t we set-up barriers in our minds - 
inhibition: which fashion how we classify 
people and, consequently, how we treat 
them. This can be a staggeringly rational 
process. One influence on the form of 
education, tlrt intellectually handicapped 
people receiv , ' the workings of govern- 
ment bureaucracy. Government policy 
suggests, for example, that disabled chil- 
dren should be integrated into ordinary 
schools. 



Integration into normal schools 

The "integration policy" - as it is now called 
by bot/ parents and the newspapers alike - 
probably emanates from an administra- 
tive need to economise, on behaif of taxpay- 
ers, regarding the cost of special schools to 
the community at large. However, the 
argument for integration rests mainly in an 
egalitarian myth which suggests that 
handicapped children should have the 
same form of education as other children. 
This is supported by a behavourist argu- 
ment that handicapped children will, in 
mixing with other children, become as 
normal as they are likely to. This argument 
is supported by the parents of handicapped 
children but refuted by those of others who 
believe that, by interacting socially with 
handicapped children, their children, too, 
will become handicapped. These argu- 
ments, given by parents and others on both 
sides, are simplistic. There is, however, 
some behavioural validity to both sides of 
the argument. 

Integration at the classroom level 

What this paper addresses is some of the 
possibilities regarding using computer 
aided learning as a mechanism for integra- 
tion (see Coldwell 1983). Before discussing 
this, however, we should look briefly at 
some of the difficulties that occur, at pres- 
ent, in integrating handicapped children 
into ordinary classes. 
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Normally, a teacher in an ordinary school 
can. manage, say, thirty children for a while, 
at least, before, due to tiredness, anarchy 
occurs. In a special school, a far lower 
teacher to child ratio - of, maybe, one 
teacher to five handicapped students - is 
considered normal. Integrating one handi- 
capped child into a normal class of, say, 
twenty children can cause pandemonium. 
A teacher, if she is able to manage, reaches 
exhaustion quicker and, clearly, needs the 
help of an aide to manage the handicapped 
children. This refutes the false argument 
concerning funding economies. Chaos still 
occurs. But the handicapped children are 
being managed, often, by untrained aides 
and the concentration of the other children 
is still disrupted. This would, one assumes, 
affect the progressof all of the children both 
handicapped and unhandicapped. 

Some brief thoughts on wtism 

It is necessary to explain what kind of dis- 
ruption occurs. To do so, I will try to 
describe one of the worst instances of 
communication disorder that there is. This 
is called "autism". 

Autistic children are often mute, with- 
drawn, hyperactive, and uncommunica- 
tive and, therefore, unable to read or write 
because they have difficulty in attributing 
meanings to alphabetical, numeric*!, spo- 
ken, sound and body language symbols 
(see Cbldwell 1985a). Their response to 
social interaction often appears to be non- 
existent. Seemingly through frustration, 
some develop rages. Often their behaviour 
is interpreted as anti-social whereas it is, 
we believe, merely asocial Often their 
actions are repetitive and, perhaps, ritual- 
ised. They may do the sa* ae thing continu- 
ally for hours seemingly with no reason. 
The target of their fascination is, some- 
times, a washing machine, a door handle or 
a similar piece of equipr .^nt (see Montes- 
sori teaching theory). 
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A simple instance will demonstrate one 
major difficulty wilh teaching autistic chil- 
dren. If we imagine that an autistic child 
could ask a question, the folio wing dia- 
logue might occur : 

Child: "What's your name?" 
Me: "Roger!" 
Child: "What's your name?" 
Me: "It's Roger." 

Child: 'mat's your na Tie?" 
Me: "I said It's Roger!'" 

Child: "Whaf s your name?" 
Me (now in frustration): "My name is 
Roger Coldwell." 

If we examine my responses, we see that I 
have given four different replies to the 
samequestionfromthechild. Toanautistic 
child, this is fickle; hence their confusion 
with normal social interaction. 

Their communication ability seems to be 
able to cater witu logic but not with the 
illogical component of (and certainly not 
the humour in) our communication. Let us 
imagine a similar communication with a 
computer: 

Child: "Whaf s your name?" 
Computer: "Fred!" 
Child: "What's your name?" 
Computer: "Fred!" 
Child: "What's your name?" 
Computer: "Fred!" 
etc., etc. 

This constant play on logic seems to be 
necessary for an autistic child to see a pat- 
tern in the learning process. It is found in 
the user friendliness of the response of a 
computer of enquiries to it. Computer 
aided learning for autistic people is, there- 
fore, strangely successful although it has 
yet to be demonstrated to the satisfaction of 
the psychological world which has, in 
general, taken a hostile standpoint towards 
its use as a learning mechanism for autistic 
children. 
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Computer aided learning for autisic 
children 

For the last thirteen years, the writer has 
been working with autistic, Down's syn- 
drome, epileptic and a few other types of 
intellectually handicapped children (see 
Coldwell 1985b, 1987b). This has involved 
him experimenting originally with highly 
structured computer aided drafting (CAD) 
systems (e.g. RUCAPS) and, later, simple 
educational graphics-based systems (e.g., 
LOGO) (see Coldwell 1986). The former 
were over-structured and the later are too 
primitive to be of practical use as a com- 
puter aided learning tool. A reasonable 
compromise is the new range of micro- 
computer based CAD systems like "Au- 
toCad". The benefit of using this sort of 
software is its logical though flexible struc- 
ture (see Coldwell 1987a). (These have 
now, of course, been surpassed by total 
systems, like Plato, which are available on 
our communications network.) 

I normally work with a child with a dual 
control so that the child uses a mouse while 
I communicate with the child via a key- 
board through the microcomputer. The 
process that I follow involves the child 
developing a set of their own drawings 
through a stag? involving hieroglyphic 
meanings into use of alphabetical symbols. 
Hence, they draw a cat, store it as "c" for 
"cat", retrieve it and use it to create pictures 
together with "dog", "house", "mummy" 
etc. Eventually, I save the symbol with the 
full name of "cat" needing them to extend 
their vocabulary to gain its use. Initially, 
retrieving three "cats" will involve them 
pressing the "c" key three time* but, even- 
tually, they will use the number "3" to do so 
etc. The process involves their ascribin' 
meanings to the symbols. Using a pre-se 
library of symbols would not do this of 
course. 

This whole process has severe limitations 
however. Normally I travel to them or they 



travel to me with a parent. This is an 
incredibly time consuming process for 
both sides and involves expensive travel 
for people who already have a large part of 
their single-person income eaten away by 
travel costs and other related expenses. 
(Appreciate, here, that the mother's time is 
often spent totally on supervising the autis- 
tic child.) 

Networking schools 

Our first move to counter the geographic 
problems involved in communicating with 
schools is tc use Plato on the Vicnet Com- 
munications Network to communicate, 
from the Royal Melbourne Institute of 
Technology, with the Warrnambool Insti- 
tute of Advanced Education. At the 
Warrnambool Institute, there are Depart- 
ments of Teaching and Computing and an 
external Studies Unit which is, at present, 
giving distance courses to paraplegics. 
(The Department of Teaching already has a 
course in special education). This is an 
initial phase which will precede extending 
the network out to a school in the 
Warrnambool area to enable a teaching 
aide to connect-up with the Warrnambool 
Institute as a Centre for western Victoria. 
This will enable direct contact between 
RMIT and children in classrooms in west- 
ern Victoria or, alternatively, enable similar 
contact between them and someone at the 
Warrnambool Institute. Where parents of 
handicapped children have microcompu- 
ters at home, they, too. may be able to 
connect-up to the Vicnet communications 
network. 

Centre for social computing 
applications (CeSCA) 

Computer aided learning focal points are 
needed in tertiary institutes throughout 
Australia to create centres for social com- 
puting applications. Networking schools 
to integrate handicapped children is but 
one of their possible functions. Another is 
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the creation of software that is needed to 
assist teachers to communicate, in dialogue 
with children in one-to-one interaction, 
while much of the repetitive learning is 
managed by child-machine communica- 
tion. 

What have we r'one regarding this? 
Throughout the ' -jt couple of months, I 
have advertised in Departments of Com- 
puting of the tertiary institutes throughout 
both Victoria and Tasmania (with astound- 
ing success) asking people to write soft- 
ware for intellectually handicapped chil- 
dren. The advertisement has also been 
reproduced in the "Bulletin" of the Austra- 
lian Computer Society; it has appeared on 
noticeboanis of computer rooms of com- 
mercially orientated organisations as far 
away as Adelaide and been reproduced ii. 
most of the newsletters of Associations for 
people with different types of disability in 
Victoria. (As the writer was working, a 
moment ago, the phone rang with a call 
from Brisbane.) I have also appealed to our 
own faculties for obsolete microcomputer 
hardware and received a mixture of differ- 
ent machines that we will be using to create 
software for the use of intellectually handi- 
capped and disabled children who are 
being integrated into schools. 

The function of this installation could also 
be as a computer laboratory for the use of 
disabled students of the Institute ("Dis- 
Iab") who are disadvantaged, compared 
with other students, because of their dis- 
ability. It can also be used to coach mem- 
bers of staff who are apprehensive about 
entering their own computer laboratories 
as novices. 

Most important of all of our plans is to use 
communications networks to communi- 
cate with children in schools throughout 
Australia to familiarise them with the Insti- 
tute. In communicating with the RMIT, via 
modem, they will be one step closer to 
tertiary education. We hope, too, that 



many disabled students will be amongst 
them. Some part of industry will, we hope, 
develop sheltered workshops to enable our 
disabled graduates to work, alongside 
their more able colleagues, in industry. 
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campus: CAI to increase student music literacy skills 
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Traditional approaches to teaching Music 
in both schools and tertiary institutions 
have not led to universal Music Literacy. 
Graduate teachers on entering primary 
service, aware of their inadequate music 
skills, generally avoid teaching the subject. 
As a consequence, the status is perpetu- 
ated. To redress this situation, there is an 
urgent need to institute innovations, at the 
tertiary level, which will ensure the acqui- 
sition of adequate music teaching skills of a 
level sufficient for the primary classroom, 
especially since the introduction of the 1984 
Music K-5 Curriculum which makes the 
teaching of the subject mandatory. 

Organizational structure of many teaching 
programs does not permit the learning of 
mu5»ic skills to be evenly spread over time 
so frequently what is learned in isolated 
blocks is not maintained. In addition the 
very nature of music practical skills, in 
particular, demands time for consolidation 
and maturation of coordinated move- 
ments. 

It is proposed that if students take one hour 
units spread over their entire program 
using Computer Managed Instruction to 
supplement formal block semester lec- 
tures, aral benefits may result. It is ac- 
cepted generally that students learn at dif- 
ferent rates. Consequently, when individ- 
ual control over how often to take instruc- 
tion is made available, and when programs 
that only permit progress after mastery 
levels have been achieved are used, result- 
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ing skills should be of a higher order. Fur- 
thermore, because learning has been 
spread over time, these skills are more 
likely to be maintained. 

As a trial for this hypothesis, the writer has 
begun a study with a group of first year 
students at Nepean CA.E. for whom a 
controlled number of trials on a specific 
program will be conducted. Student prog- 
ress will be indi vidually monitored and on- 
going changes emanating from student 
data will be made. A program designed by 
the writer for primary school children will 
be used for the initial trial. One accepts that 
many of our students have limited com- 
puter skills at this level and the program 
has been designed for the novice. After this 
first study, it is anticipated that, depending 
on student response, the program will be 
modified for the mature student. The 
writer is also currently investigating the 
status of C.A.I. in other teacher training 
programs within Australia. 

Music education in the tertiary sector 

One of the major concerns of music educa- 
tors in the tertiary sector is to determine the 
most efficient way to make use of the lim- 
ited time allocated to the teaching of music 
in the preparation of teachers for primary 
service. The majority of students entering 
pre-service primary training exhibit lim- 
ited musical skillsin terms of music literacy 
and practical musicianship. Since 1984, the 
release of the N.S. W. Departmer t of Educa- 



Using Computers Intelligently 



421 



tion Music K-6 document has nude the 
teaching of music mandatory, so there is an 
uigent need to ensuie students graduate 
with adequate skills to implement the cur- 
riculum In the past, the teaching of music 
has proven resistant to traditional ap- 
proaches. 

The proposition that all individuals have 
the potential to develop music skills to a 
level which enables them to participate in 
understanding basic concepts and express* 
ing musical ideas through creative endeav- 
ours is indirectly supported by the Music 
K-6 document. Those of us committed to 
music education have long held the view 
that innate musical ability is not essential to 
achieving a level of skills commensurate 
with the level demanded in any other sub- 
ject area. For example, all children receive 
education in the language arts which will 
ensure a facility to communicate through- 
out their lives and there is no expectation 
that this learning will necessarily result in 
literary skills of an exceptionally high or- 
der. The same proposition holds true for 
the learning of music skills and therefore 
one should not expect that children receiv- 
ing a music education will necessarily be- 
come professional musicians. 

For those whom psychologists would 
identify as musically "gifted" , a general 
music education in the fundamentals of 
literacy, creativity, performance and audi- 
tory imagination and analysis, will provide 
a sound foundation. For these individuals, 
studies in music of a more intensive and 
rigorous nature may result in the acquisi- 
tion of high order music skills leading to 
either committed amateur or professional 
musical status. But our major thrust should 
be to ensure a fundamental grasp of music 
literacy skills for all children. Therefore, 
just as language studies are taught, in order 
that individuals may communicate in a 
social environment, so should music skills, 
of a level adequate to enable children to 
engage in a variety of music activities, 
thoughts and discussions, be learned. 



It is acknowledged that as adults, we do 
engage in such processes. The recent Re- 
port on the Music Industry by Dr. Hans 
Gulberger (October, 1987) has highlighted 
the extent to which Australians are in- 
volved in music. His data show it to be a 1 .6 
billion dollar industry employing more 
than 60,000 individuals, as well as a grow- 
ing industry, with the numbers of music 
teachers and musicians having doubled 
since 1961. This increase seems to parallel 
the growth of music through the mass 
media and the exposure society now has to 
various forms of music which includes 
popular, jazz, classical European and to 
some degree classical non-European idi- 
oms, as well as folk music. The degree to 
which individuals are involved in music 
varies and the level at which one may be 
involved, diverse, but the size of the indus- 
try suggests that the greater majority of us 
have some involvement which further re- 
inforces the proposal for universal music 
education. 

In the past, the "musically gifted" have 
been the main recipients of individualized 
music instruction, frequently receiving 
tuition from the private sector. Less atten- 
tion has been paid to the educational main- 
stream. The main reasons for this have been 
firstly, the lack of sufficient music special- 
ists and secondly, the generally limited 
skills of the regular classroom teacher. 
Froma financial point of view, the proposi- 
tion of specialist music teachers for all 
schools is unpalatable to the funding bod- 
ies. The acquisition of high order music 
skills in the areas of instrumental and vocal 
performance skills, composition, analysis, 
aural skills and the like, which form the 
basis of a music specialist's expertise, take 
years to attain. The cost therefore to pro- 
duce sufficient music specialists for the 
primary classroom would be considerable. 

The alternative, which has been promoted 
as having a sounder philosophical basis, is 
to train primary teachers with a level of 
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music skills which will enable them to 
understand and manipulate musical con- 
cepts sufficient to satisfy the demands of 
the curriculum. (As a side issue, it is an 
unfortunate fact that accountability of 
teacher training courses in this regard is 
non-existent I am not aware of any analysis 
which has tried to correlate the skills of 
primary teachers when the exit their 
courses with the demands of the classroom, 
taking into account the existing primary 
curriculum.) Nevertheless, this should be 
the aim of preservice primary programs. 

And here we find another difficulty which 
isrelated to the general structure of teacher 
education programs whose units, for con- 
venience, are in large blocks. For example, 
in my own institution, First year students 
have a one semester Introductory Course in 
Music at the beginning of their training, bu t 
there is a period of two semesters before 
they meet the subject again by which time 
the skills achieved in the earlier encounter 
are greatly diminished. Music is a subject 
area which demands continuity, time to 
consolidate and exteni both the intellec- 
tual processing of musical concepts and 
practical motor skills for instrumental 
development. Two final considerations 
need to be addressed; rate of of student 
learning and the entry skills. Taking the 
first, educators accept that students do 
learn at different rates and we know from 
the extensive studies undertaken in special 
education that even the severely and pro- 
foundly handicapped will acquire skills, 
given appropriate teaching procedures 
and programs. For these individuals, 
intensive teaching over time will result in the 
acquisition of skills no t so long ago thought 
of as unattainable in such a population. 

If we apply the same reasoning to the 
acquisition of music skills at the tertiary 
level, it is feasible that trainee teachers will 
attain a level of music skills which will 
satisfy the needs of the clascroom, if their 
learning can be spread over time and 
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providing intensive training is available. 
Until recently these conditions could not be 
met. However, if students are given access 
to an interactive teaching medium, avail- 
able throughout their program, and for as 
often as is required to reach a mastery level, 
we see a more promising scenario. 

Looking at the second condition, that of the 
very diverse skills levels of students enter- 
ing p re-service primary education pro- 
grams, we find that Introductory Studies in 
Music Education is not only boring for 
students who may have taken music at year 
twelve level, but also a waste of student 
time which might well be used in either 
extending their existing skills in music or 
remediating deficits in other areas. At the 
other end of the spectrum, there are those 
students who do not possess the most 
rudimentary music understanding and for 
whom additional teaching is essential. If 
these students have access to an interactive 
teaching medium, on an individualized 
schedule, they will all benefit in terms of 
time spent to reach a predetermined crite- 
rion. 

So, in summarizing this preamble we con- 
clude the following; 

• music plays an important part in adult 
society 

• all children have the potential to acquire 
music skills 

• all primary teachers need basic class- 
room music skills as prescribed in the 
curriculum 

• music learning during preservice train- 
ing needs to be spread ove* time 

• students learn at different rates so ac- 
cess to learning according to need will 
be more efficient and effective than 
group instruction 

• both C.A.L and C.M.I. have the poten- 
tial to provide such access 

We therefore hypothesize that; 

• decentralized learning on the tertiary 
campus, used in 
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• conjunction with more traditional ap- 
proaches, should lead to increased 
music literacy for trainee teachers and 
ultimately, for all primary school chil- 
dren. 

Computers as music teachers 

At the very outset we wish to emphasize 
that Computer Assisted Instruction in 
music is not expected to solve all the prob- 
lems of Music Education in Teacher Train- 
ing. However, dearly it does have the po- 
tential to assist tertiary music educators in 
overcoming some of the existing difficul- 
ties. No-one would suggest that all music 
courses can be taught more appropriately, 
or even at all, using the new medium any 
more than one would suggest that any one 
method of teaching is justifiable. An eclec- 
tic teaching style which ranges from direct 
instruction procedures to exploratory 
learning experiences is eminently suitable 
for the varying components of music learn- 
ing. There are those factual aspects c ( music 
which remain unchanged such as pitch, 
intervals, history, analysis and the like 
while other endeavours such as composi- 
tion or an understanding of orchestration, 
are eminently suited to a discovery learn- 
ing approach. (How many compositions or 
orchestral arrangements anguished over 
by students during training, never reach 
their ears through instrumental realiza- 
tion?) 

Synthesized sound capabilities of the 
microchip will make the acquisition of 
these skills in particular more efficient us- 
ing C.A.I. as students manipulate their at- 
tempts while simultaneously receiving 
aural feedback. 

The microcomputer is also eclectic in the 
various teaching procedures it can present, 
again eminently suitable for the learning of 
a wide range of music skills. Its ability to 
present text and musical notation through 
tutorials for skills acquisition, to provide 
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drill and practice for speed and fluency, to 
provide simulations, games and problem 
solving activities for generalization and 
extension, make the microcomputer a ver- 
satile instructional medium. Its facility to 
allow interaction between teacher and 
learner, further enhance its qualities as an 
educational medium. 

Many advantages, well documented for 
other subject areas are relevant to the teach- 
ing of music and, in addition, there are 
special features which are particularly 
appropriate to music learning. 

In general terms, the computer is able to; 

• pre-test students so they enter the pro- 
gram at an appropriate level 

• present music sounds, notation and 
written text 

• analyze student responses, both written 
and musical 

• provide objective, instantaneous feed- 
back 

• as a consequence, increase potential 
learning time 

• give immediate and appropriate rein- 
forcement 

• keep student records and identify, for 
the lecturer, those students in need of 
additional help 

• enable students to be actively involved 
in the teaching/learning process 

• provide motivation through moving 
graphics and sound 

• provide further motivation because of 
the confidentiality of learning 

• spread learning over time 

• give students control over the amount 
of learning required for mastery 

• block students from progressing until 
mastery is achieved 

• give student access to learning outside 
the lecture room 

• move students to new levels or offer 
remediation, as required. 

• provide students with programs which 
will ensure a level of basic skills pre- 
requisite to their courses, perhaps in the 
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form of a bridging unit. 

• permit lecturers to proceed at a faster 
ratebecause of acquisition of these skills 
thereby leading to further extension of 
skills 

In more specifically music oriented tasks, 
the unique characteristics of the computer 
offer; 

• the provision of moving graphics to il- 
lustrate certain concepts of music 
which is particularly relevant, given the 
transient nature of sound 

• the provision of sound itself, now avail- 
able with most microcomputers 

• the ability to present monophonic and 
polyphonic sound 

• the attachment of the MIDI (Musical 
Instrument Digital Interface) tlirough 
which certain synthesizers, keyboards, 
sequencers and samplers may be con- 
nected to the microcomputer 

• the ability to reproduce at an ever in- 
creasingly sophisticated level, the 
sounds of conventional instruments as 
well as previously unknown timbres 

• the printing of musical notation and 
scores 

• the ability to analyze information and 
keep data bases' 

• the ability to receive sound stimuli from 
the student, analyse it and report to the 
student 

There are also direct benefitsf or the teacher 
because the computer allows him to; 

1. pre-program systematic instruction 

2. ensure relevant sequencing 

3. revise and update the program accord- 
ing to student performance 

4. individualize aspects such as reinforce- 
ment schedules according to student 
needs 

5. be relieved of repetitious teaching 

6. keep records automatically 

7. spend more time on class management 
and organization of programs 

Not only is the computer able to provide 
direct teaching, it can also provide a means 
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of allowing explorations into the domain of 
creativity. "The clearest trend in C.A.I., " ( 
Upitis, 1983) * is that computers are being 
regarded less as a vehicle for delivering 
programmed instruction and more as a 
means for allowing children to actively 
manipu late variables and solve problems/' 

Generally, music educators would agree 
that the most efficient way for children to 
learn music is for them to experience it in 
the most practical ways whether through 
movement activities, singing, instrumental 
experimenting, or creating their own com- 
positions. Seymour Paperfs theories con- 
cerning the acquisition of mathematic skills 
similarly suggest that children should 
"do" maths rather than "know" maths and 
through LOGO this has been made pos- 
sible. The little known LOGO music sys- 
tem, was developed primarily to teach 
composition. 

Logo is a computer language written in the 
computer language Lisp which has been 
much used in programming artificial intel- 
ligence. ( Baugh, 1987). Despite this, its 
principal function is " not so much to allow 
children to engage in computer program- 
ming but rather to act as an environment in 
which they may learn about the particular 
subject matter in hand and also to learn 
about their own thinking." (Stevens, 1987) 
Thus i n terms of problem solving activities, 
Logo encourages the child to explore his 
critical thinking skills. The two primary 
types of Logo are Terrapin Logo, devel- 
oped at M.I.T. and the other, L.C.S.I. Logo 
from Logo Computer Systems. The former 
includes Commodore Logo, P.C. Logo for 
the I.B.M. P.C. and Krell Logo and Terrapin 
Logo for the Apple 11 series, while the latter 
is used for Apple Logo, Apple Logo 11 and 
Sprite Logo for the Apple 11, Atari Logo, 
IBM Logo and Logo for the Apple Macin- 
tosh. (Baugh, 1987) Perhaps the main dis- 
advantage of Logo is that one cannot use 
traditional notation or note names to define 
pitch or duration with numbers or letters 

4 



Using Computers Intelligently 



425 



being used to assign these elements. For 
more detailed descriptions of the use of 
Logo music, see Stevens, (1987). 

There is now a number of high level lan- 
guages which can be used by teachers to 
create their own programs. Super-PILOT 
allows one to program sound, graphics and 
text relatively easily using a series of mne- 
monic, alphabetic commands to control the 
operation of programs. Music teachers' 
entry into this part of the process "may 
result in a fresher approach to some teach- 
ing problems/' (Placek and Jones, 1986). It 
will certainly encourage music teachers to 
be analytical in lesson planning. Clearly, 
music ca.i. is more than drill and practice 
of theory as so many music teachers be- 
lieve. 

Continuing research on the effects of using 
computers to teach music is an important 
issue, not only informative on the specific 
outcomes of studies but also for the general 
conclusions it produces. Placek's study 
(1974) with students majoring in elemen- 
tary education presented a C. A.I. lesson on 
rhythm, recording data on total time spent, 
amount of program covered, amount of 
time on each main routine, number of at- 
tempts and corrects and errors, and other 
aspects. The post intervention data with 
students found they enjoyed the lesu)n and 
learned the basis behaviours taught, and as 
well, they identified some deficiencies in 
the program. However an even more im- 
portant outcome related to the develop- 
ment of goals and objectives for music 
education generally. 

"Because of the deterministic character 
of digital computer:, identifying and 
defining musical behaviours seems to 
be a natural outcome of planning, pro- 
gramming, and producing music les- 
sons for computer aided education sys- 
tems." 



In the past, many music teachers have been 
reluctant to state objectives on the grounds 



that music is an art rather than a science. 
However, the demands of programmers in 
developing software may lead to improve- 
ment in this area as specifying precise 
learning outcomes is an essential part of 
instructional programming. 

One further aspect not previously consid- 
ered is that of student motivation. Certain 
computer programs have been found to be 
highly motivating, an important aspect of 
all learning. Recognizing the powerful 
motivation factor in video games, Chaffin 
et al (1982) called for the identification of 
those variables associated with the motiva- 
tional aspects of the games so they could be 
applied to educational settings. Malone's 
study (1981) resulted in the general classifi- 
cation of motivational aspects under three 
categories- challenge/ fantasy and curios- 
ity. Fredericksen et al (1982) described 
three computer games designed to im- 
prove reading skills which incorporated 
the motivational features of video games. 
They cited; 

1. clear cuts goals, 

2. fast pace 

3. unmediate feedback 

4. variable levels of challenge as impor- 
tant features. 

In designing software for music, considera- 
tion should be given to this issue. 

Should we as music teachers use comput- 
ers to teach our precious art? Is there justi- 
fication for bringing technology into the 
music room? Can the computer teach as 
well as the teacher? Can it possibly teach 
some aspects in a superior way? 

One crucial aspect of music learning is that 
of repetition. The skill intensiveness of the 
subject whether it be for developing the 
motor skill of instrumental playing or the 
more intellectual processing of recognizing 
and analyzing sound patterns, demands a 
high level of individualized instruction 
and repeated practice which in the past has 
been difficult to provide. Without the di- 
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rect intervention of a teacher the microcom- 
puter can: 

• present a stimulus 

• accept a response 

• evaluate the response 

• give feedback 

• give immediate and appropriate rein- 
forcement 

• move to the next instructional sequence 
or branch to further explanations 

• record results 

And repeat the task endlessly. 

According to Hofstetter (1979) "there is no 
other discipline for which microelectronics 
are better suited than music education. 
Although still in the infancy stage, micro- 
computers are able to produce music nota- 
tion, generate aural stimuli, judge re- 
sponses, and diagnose student learning." 
Given appropriate software based on 
sound instructional design and with ap- 
propriate teaching procedures, many as- 
pects of music knowledge can be learned 
with minimal teacher intervention. 

Whether the new technology will be inte- 
grated in music education is not in ques- 
tion. "The challenge to education in the 
1980s is how best to use computer course- 
ware to improve instruction." (Wilson and 
Fox, 1982). 

If music education is to survive, it must 
accept this challenge. Not a panacea for the 
problems of music education, the com- 
puter, because of its interactive nature, and 
the versatility of teaching procedures, is a 
medium unlike any other teaching aid, and 
holds great promise. 

Peripherals to enhance performance in 
music learning 

In addition to the microcomputer unit itself 
which includes an attached qwerty key- 
board to access information, there now 
exists a number of attachments known as 
peripheral devices which enable musi- 
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cians and music teachers to more easily 
access the computer. During the 1960s and 
1970s, music specific attachments were 
developed which were expensive and 
sometimes cumbersome. Since 1983, the 
development of MIDI,(Musical Instrument 
Digital Interface), has revolutionized com- 
munication between computer and vari- 
ous musical instruments. With suitable 
software, a synthesizer connected to the 
computer via MIDI can be used as a real- 
time music input device for composition or 
performance, for learning keyboard skills 
or music theory as well as other music 
activities. Through the music keyboard, 
notation can be displayed and edited, then 
played according to the user's directions. A 
hard copy of the resulting music manu- 
script can then be printed. In the case of 
learning piano keyboard skills, the com- 
puter is able to direct the student to per- 
form and provide feedback on the accuracy 
of the student's performance in much the 
same way a teacher would. 

There are various devices which can be 
connected similarly. These include synthe- 
sizers, both monophonic and polyphonic, 
electronic keyboards, drum machines, 
samplers, sequencers, and even special 
sound effects devices, each adding diver- 
sity to the computer's regular functions 
and providing facilities not readily avail- 
able in the regular music room. Some 
devices have MIDI inbuilt while those 
without may be interfaced by an independ- 
ent MIDL There also exists a range of syn- 
thesizers for non-keyboard musicians 
which are similar to an auto-harp but hav- 
ing controls similar to those used by wood- 
wind players or guitarists. Expanders, 
which are sound devices having no direct 
controls themselves, can be played by 
another keyboard or synthesizer to extend 
its tonal range. Mixers, compressors and 
equalizers may also be used for specific 
purposes. For further information on these 
peripherals see N.S.W, Department of 
Education publication Music and Comput- 
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ers (1987), or Stevens ( 1985, 1987) and 
Wells and Kemp (1985). 

Music editors for microcomputers, though 
not originally created for music education, 
also have a valuable contribution to make. 
An article by Mercuri( 1981)gaveacompre- 
hensive description of nine such programs 
listing some 37 characteristics which pro- 
vided useful information. "The music edi- 
tor may be used as a motivating tool for 
children to pursue additional and more 
varied musical activities/' (Upitis, 1983). 

In the past, particularly at primary level, 
composition and creative musical pursuits 
have not been high on the list of priorities 
although the new K-6 Music Curriculum 
has identified this as an important area. It 
may have been due to the lack of musical 
knowledge and experiences of the class- 
room teacher that this occurred. By the 
early 1980s it had become apparent that 
music editors could give children opportu- 
nities to experiment with musical ideasand 
patterns. Having such programs available 
in the classroom may not only assist the 
children but also the teachers to gain expe- 
rience and confidence in such musical ac- 
tivities. 

The most recent curriculum dc cements on 
music learning both within Australia and 
overseas, place emphasis on the learning of 
music through listening, performing and 
composing. The vast array of electronic 
musical instruments in their various forms 
including those which can be interactive 
with a computer to provide G A.I., offer to 
the music teacher and the student ready 
access to a range of instruments and sounds 
as well as learning experiences not previ- 
ously available. It is important therefore 
that we accept the new technology, capital- 
izing on its benefits in enabling children to 
work with another learning tool. 

Applications of computer technology in 
music education 



The first reported use of computer assisted 
instruction in schools was in 1959 in New 
York State so we have had 30 years to 
acquire some understanding of the poten- 
tials and pitfalls of the technology in gen- 
eral education. Since the late 1960s, there 
has been recorded a variety of m is\c inter- 
ventions using the computer as the teach- 
ing medium. Much of the earlier instruc- 
tion was given at universities in the U.S.A. 
and included such areas as aural training, 
sight-reading, rhythm perception, analysis 
and composition. 

Allvin's work at Stanford to teach sight 
singing (1967), Placek's much reported 
PLATO system at the University of Illinois 
to teach rhythm tasks, and the work of 
Lamb and Bates, University of Canterbury 
in England, which concentrated on aspects 
of melody, harmony and rhythm were all 
forerunners to later studies which have 
grown in diversity. Ned DiehTs work 
developing peripherals for the IBM 1500 
computer to teach articulation, phrasing 
and rhythm for wind instruments, pointed 
to new directions in music teaching, (Deihl, 
1971). 

By 1974, PLATO had produced courses on 
the following topics; Tests and Measure- 
ments in Music Education (Colwell and 
Weimer); Instrumental Methods Series - 
wind and percussion (Peters); Percussion 
Terminology (Fairchild); Violin and Viola 
Fingering Drill (Lind); Instrument Recog- 
nition (Holden); Micro-teaching in Music 
Euucation (Dvorak); Critical Incidents in 
Music Education ( Cooksey); Hand Signals 
for Music Teachers (Flohr); Elementary 
Music Fundamentals (Placek and Peters); 
Part Writing (Rickman); and Jazz Chording 
(Rucinski.) Programs being developed at 
that time evidence versatility. 

One area to receive considerable attention 
is that of aural training. Such is the intensity 
required to master the skill, even prior to 
the advent cf ihe computer, non-teacher 
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centred programs were devised using the 
tape-recorder. Kuhn at Stanford (1974) and 
Hofstetter at the University of Delaware 
(1975) developed computer programs in 
this domain. Studies by Herrold (1973) and 
Killan and Lorton (1974) documented the 
effectivenessofKuhn's programs. By 1975, 
with the help of record keeping by the 
computer, Killam et al, were able to re- 
search into how students develop aural 
skills and how to .establish a hierarchy of 
learning concepts. Hofstetter's work on the 
GUIDO (Graded Units for Interactive Dic- 
tation Operations ) system led to research 
by showing that, compared with a control 
group, students using GUIDO for ear- 
training, performed significantly higher. 
Computerized aural training (Lees, 1980) 
concluded that "the computer program 
was in virtually every aspect vastly supe- 
rior'' to her own tape-recorded program. 
And further, the computer's ability to diag- 
nose individual stuaanf s difficulties and 
present examples of that type, was a par- 
ticularly significant innovation. 

Taylor (1982) using MEDICI, an interactive 
computer-based dictation system with ter- 
tiary students, sought to compare student 
gains using traditional piano dictation and 
the PLATO System interfaced with the 
Gooch Box, a v** c " ' music synthesizer. 
While all student she ,/ed gains in skills, 
those using MEDICI did not produce sig- 
nificantly higher results. However, the 
T>mputer offers advantages of releasing 
the teacher for other functions, reduces 
repetitious teaching and allows students to 
work according to their own needs and 
timetable constraints. Woods (1986) in 
describing a jr f ulation of young children 
of whom 30% were unable to sing in tune, 
stated that less than 3 hours of c.a.i. instruc- 
tion was sufficient to remediate their prob- 
lem. 

Diehl's students (1971, 1973) using the 
I.B.M. 1500 showed significant gains in 
instrumental performance. His studies 
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a'med to have students develop more 
'sensitivity and accuracy" in performing. 
Musical notation displayed on the screen 
together with pre-recorded musical ex- 
amples were devised for flute, clarinet, 
oboe, saxophone, trumpet and baritone. 
Significant gains especially in phrasing 
were evidenced. Peters (1975) developed 
for PLATO a series of programs for flute, 
clarinet, oboe, saxophone, bassoon, trum- 
pet, horn, trombone, euphonium, tuba and 
percussion. Using tutorial format, stu- 
dents were automatically moved to more 
advanced materials or branched to reme- 
diation according to their needs. 

Programs in fundamentals of music theory, 
employing tutorials and drill and practice 
proliferated at the tertiary !evel in the 
U.S.A. Studies in Set Theory (Wittlich, 
1974); Composition, programs by Nelson 
and Wliite (in Hofstetter, 1975), Appleton 
and Alonso (1975); Analysis (Hofstetier, 
1972); Whitney (1975); Information Re- 
trieval (John, 1969, 1971); Automated 
Music Pr nting (Lelena Smith, 1973) further 
illustrate the variety of music ca.i. in the 
1970s. Bamberger (1974, 1979) explored the 
use of LOGO with a group of children who 
were able to manipulate sounds of differ- 
ent pitch and duration by using letters, 
number and words. The resulting music is 
then played by the program. 

Through the 1980s there appeared a t 'eth- 
ora of courses to teacn music fundamen- 
tals. Lamb, (1982) developed an interact: . . 
system which allows musical concepts to 
be modeled graphically. His program 
makes less demands than the LOGO sys- 
tem while still offering similar games using 
traditional notation. At the same time, 
work on computer managed instruction 
began to appear. Recognizing that in indi- 
vidualized performance-based instruc- 
tion, students do proceed at different rates 
and experience different forms of learning 
difficulties, it was acknowledged that, if 
teachers monitored student progress, they 

38 




Using Computers Intelligently 

could assist individuals in need. Arenson's 
development of the PLATObased C.M.I. 
led to the conclusion that if students are 
given self-paced CA.I. , teachers have 
mo r e time for individualized instruction 
on a needs basis. 

Arenson (1982) examined the effect of a 
competency- based education program on 
the learning of fundamental music skills 
with a group of ternary students using ihe 
PLATO system at the University of Dela- 
ware. His results supported the premise 
that drill and practice procedures in this 
area when provided by the computer pro- 
duced significantly superior results in 
learning than for the control group. 

We conclude that programs to teach a wide 
range of skills have been successful but 
how extensive is its u$' * In a study of 429 
music departments in the U.S.A., Jones 
(1975) concluded the following; 

Despite evidence of the computer's 
value for instructional uses, the educa- 
tional community has been reluctant to 
accept and develop computer assisted 
instruction for music. Reflections of this 
reluctance are manifold: 

(1) few music educators are involved in 
teaching by computer systems, 

(2) few students are involved in re- 
search in computer assisted instruc- 
tion as learners, 

(3) few music educators and graduates 
are involved in research in com- 
puter assisted instruction, 

(4) few quality :ourse materials are 
available, and 

(5) no formal mechanisms exist for shar- 
ing computer assisted instructional 
efforts in music. 

As an outcome of Jones' recommendations, 
a National Consortium of Computer- 
Based Musical Instruction was formed in 
the U.S.A. As worthy as the aims of this 
body appear, mai.y of Jones allegations still 
hold true. While articles in a wider variety 
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of journals can now be found discussing 
music C.A.I., there still exists a dearth of 
reported research on specific learning ov 1 
comes. 

Currently in Australia, articles are few and 
research almost non-existent. The technol- 
ogy is here, the software is becoming more 
readily available and affordable as well as 
improving in some aspects, peripheral 
hardware has reached quite sophisticated 
levels, justification of its potential value as 
a teaching medium widely discussed, but 
development is not widespread. 

With the establishment of the PLATO 
(Programmed Logic for Automatic Teach- 
ing Operations) at the University of West- 
ern Australia in 1985, using the GUIDO 
program there is an expectation that on- 
going re^ irch into *he effectiveness of the 
programs will ensue. In a recent publica- 
tion (MacPherson,l985), some indication 
of the extent of the programs to which 
students can be exposed was given. 

As with any subject requiring the acqui- 
sition of literate or intellectual skills, the 
computer is of most use when provid- 
ing a graded series of drilled exercises. 
In traditional aural programmes at the 
tertiary level, and as reflected on 
GUIDO ear training lessons, these drill 
activitiesare mainly associated with the 
recognition of intervals, melodies, har- 
monies and rhythms, and by writing 
them down via dictation type exercises. 
The ear training curriculum of the Micro 
GUIDO System consists of five main 
lesson types i.e., Intervals, Melodies, 
Chord Qualities, Harmonies, and 
Rhythms. 

In recognition of the possibility that this 
type of learning might not suit all students, 
a two year study has been implemented to 
evaluate student progress and attitudes. 
Mr. MacPherson enunciated the problem 
faced by most music educators at tertiary 
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level, that is the wide range of individual 
differences in dictation ability, especially at 
first year level. "When using the computer, 
students receive individualized attention, 
with evaluation and feedback of their re- 
sponses being immediate. Each time a stu- 
dent masters a particular unit in GUIDO 
the computer automatically writes a star 
next to the appropriate unit on the 
student's floppy disc. By releasing the 
instructor from personal tuition, it permits 
him to become more of a "diagnostic 
consultant" who can pay greater attention 
to specific student needs. 

There is an urgent need in Au^r alia to take 
up the challenge of such research because 
it is only through empirical evidence that 
rational conclusions, which will ultimately 
benefit students, can be made. There exists 
some evidence of the success of C.A.I. to 
increase students skills, in overseas stud- 
ies. For example, the New England Conser- 
vatory of Music in the U.S.A. (Lafferty, 
1986) reported that students taking ca.i. in 
aural training increased their skills by 50% 
over students who did not use c.a.i. Such 
promises are too exciting to ignore. 

Stevens and Sillcock (1985) began a pilot 
study with members of the Defence Force 
School of Music u> assess and remediate the 
level of aural skills of musicians in the 
Royal Ausfv'fen Army and Navy bands. 
To date the results have not been reported 
but that such studies are beginning at local 
institutions augurs well for future endeav- 
ou rs in researchingc.al outcomes in music 
learning. 

Nepean study 

The foregoing evidence led this writer to 
suppose that c.a.i. in music on the tertiary 
campus could be used to answer the needs 
of primary teachers in training and that, in 
addition to its use as a group teaching 
mode within the lecture room, individual- 
ized instruction of the amount required by 
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each student could assist in raising the 
levels of music literacy for trainee primary 
teachers. If units were provided outside the 
lecture room for which students could gain 
credit in their own time, such learning 
could be spread over time thus ensuring 
maintenance of both practical and theoreti- 
cal skills. 

In 1987,a groupof 120firstyearstudentsat 
Nepean C.A.E. undertaking the Bachelor 
of Education Program in Primary Teach- 
ing, were screened for basic music literacy 
skills. A sample of the students has been 
selected to u. e a program designed to teach 
those skills presented in the pre-test. In 
1988, after a predetermined number of 
trials, the total population will be re-tested 
and data of the two groups compared. 
Whi:e it would be unwise to predict the 
outcome, there is sufficient evidence from 
other research studies to hope that learning 
outcomes will be significant. 

Conclusion 

Music educators have long sought means 
to increase the level of mu sic skills across all 
sectors of education. If we are to capitalize 
on the perceived potential of c.a.L, we need 
data on which to base conclusions, and 
longitudinal research which can be used 
for continued development. The new tech- 
nology has more to offer than any previous 
teaching tool but it needs the help of music 
teachers, musicians, curriculum experts 
and programmers who are sensitive to the 
importance of instructional design within 
the framework of the various modes of 
presentation the computer is able to offer. 
Without sound, validated design, the 
computer will not live up to our expecta- 
tions. Instructional design as an heuristic 
problem-solving process, depends on in- 
telligent decision making on the basis of 
incomplete data which must be followed 
by rapid evaluation and revision according 
to the outcomes. 



Keyboarding for information: Don't let your 
thoughts get away from your fingers 



Uni Carnegie and Michael Gerrard, School of Business 
South Australian College of Advanced Education 



The rationale for the development of a com- 
puter-based keyboard training program for 
first-year Bachelor of Business students is de- 
scribed. The textual material was developed for 
use by young adults, but has been used success- 
fully with people whose ages range from 5 to 70 
years. A sample of the relevant research into the 
acquisition of psychomotor skills is provided 
Details are given of the construction of the 
computer program which drives a learning 
package which has, in its first year of use, pro- 
vided the means whereby in excess of 150 stu- 
dents have become functionally literate at the 
computer keyboard. 



Micro computers are now being used ex- 
tensively by undergraduates in our busi- 
ness courses, not so much as a topic to be 
studied bat rather as a versatile tool to be 
used to support studies in accountancy, 
finance, administration etc. 

Most new students are not fluent in using 
any type of keyboard, but they do need to 
develop fluency quickly. Since it is difficult 
to delete any of the more 'academic' topics 
from the curriculum, keyboard skills must 
be acquired largely outside formal staff- 
student contact time. 

These constraints lead to the desirability of 
students learning with a tutorial program 
running on the micro computers which 
they will be using. While many such pro- 
grams exist for a wide variety of comput- 
ers, a quick survey of those readily avail- 
able for MSDDOS machines revealed un- 
desirable features in each case. Some were 
too tedious, some required an installation 



procedure for each student, and some were 
simply too expensive. Hence the authors 
chose to develop a new program with the 
following limited aims: 

• Useof all fingersat 15 words per mhv tc 
after 5 hours 

• Simple to start and use for students new 
to computers 

• Immediately available at any of 40 mi- 
cro computers at the College, without 
the need for a floppy disk 

• Easily distributed to external students 
who use a variety of MS-DOS machines. 

One of the authors (Carnegie) has been 
teaching keyboarding for several decades 
and had developed a successful method 
used with typewriters. This method intro- 
duces a few new keys at each lesson with- 
out any tedious drill exercises, students 
type complete sentences right from the fi rst 
lesson. The new computer program simply 
translates this proven method into a more 
modern technology. 

The first students to learn by this quick 
method were technical college lecturers 
learning on manual typewriters so that 
they could prepare lesson material and 
handouts to be run off on a spirit duplicator 
- such was the technology of 1964! They 
were predominantly men from the Engi- 
neering and Building departments. They 
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attended for a total of 5 hours - just one 
week. By that time they had learnt the 
whole keyboard, including the numbers 
(which are often left to last and then forgot- 
ten) and gained some basic skills in setting 
out material. 

Since then the method has been used to 
teach full-time students aiming to become 
pi of essional typists, as well as people rang- 
ing in age from 5 to 70. Some of the people 
were authors whose flow of ideas was 
constrained by their inability to get their 
thoughts on to paper quickly enough. One 
person came specifically to learn enough to 
prepare a list of customers and their re- 
quirements for Christmas turkeys. How 
much easier it would be for that turkey 
farmer now, storing the details on disk 
from year to year and updating the lists! 

Some principles of skills acquisition 

Keyboarding is a complex psychomotor 
skill. It demands the mental co-ordination 
of muscles to produce meaningful alpha- 
numeric text. The complexity of the proc- 
ess is demonstrated by the factors identi- 
fied by Fleishman (1966): 

• Control precision. Highly controlled ad- 
justments of large muscles 

• Multi-limb co-ordinating. Co-ordinating 
the movements of more than one limb 

• Response orientation. Fast visual dis- 
crimination with appropriate move- 
ment 

• Reaction time. Speed of response to 
stimulus 

• Arm movement speed. Rapidity of gross 
arm movement 

• Rate control. Following a moving target 

• Manual dexterity. Skilled rapid arm 
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movements 

• Finger dexterity. Controlling tiny objects 
with the fingers 

Fleishman's analysis of the stages of prac- 
tice on a complex co-ordination task such 
as keyboarding further emphasises that 
this is not a simple skill that can be left to 
chance. 

(Illustration - Stages of Practice) 

When children learn to ride a bicycle or to 
surf, they usually study what the experts 
are doing. They watch and imagine them- 
selves making the same movements. This 
kind of mental rehearsal hasbeen shown to 
be useful in establishing neural pathways 
for the sponh*npQUs execution of precise 
movements. 

When the learners pluck up the courage to 
launch into action, there is already a mental 
image of what should happen and they 
experience kinaesthesis - what it actually 
feels like. They soon learn the feel of suc- 
cessful movements and may practise for 
long periods of time to perfect a particular 
technique as they gradually refine the skill 
and develop the automaticity which is the 
hallmark of a skilled performance. 

The effectiveness of conscious mental re- 
hearsal in relation to passive observation in 
shown in the following analysis by Cratty 
(1973) of several research studies. 

(Illustration - Effective pr- :tice) 

It has been asserted (Austin & Pargman, 
1981) that the most fluent performance is 
achieved by the person who is able to leave 
the execution of the skill to the unconscious 
self. The conscious self attends solely to the 
higher order activities associated, in our 
case, with word processing or computer 
programming. 

Clearly, if keying is automatic, with stu- 
dents having no hesitation in locating the 
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required keys, they are going to be able to 
initiate the actual movement more quickly. 
This may be of marginal importance in 
computer programming, but where people 
are word processing to create original 
documents, then fluency in keying be- 
comes a critical factor. 

Denis Glencross, Associate Professor or 
Psychology at Flinders University, has 
carried out a considerable amount of re- 
search into the acquisition of typing skills. 
He has shown that Tiunt and peck' opera- 
tors show a marked improvement in both 
speed and accuracy when they retrain as 
'touch' operators. 

Using the program 

The computer program contains 24 stan- 
dard lessons, each introducing one or more 
keys, plus three explanatoi, lessons and 
two optional lessons. The student chooses 
the required lesson from the menu in figure 
1. 

Each standard lesson beginsby identifying 
the new keys and the fingers to be used. 
The students press each new key, and then 
type seven sentences which use these keys. 
Any errors are politely identified for imme- 
diate correction, and encouraging com- 
ments are displayed if the typing is accu- 
rate. 

The top half of the screen displays a dia- 
gram of the keyboard with the new keys for 
the current lesson highlighted and the 
home-keys underlined. This technique 
encourages the student's eyes away from 
the Keyboard, thus reinforcing the learning 
of the key positions without the student 
getting into the habit of 'hunting and peck- 
ing'. 

Sentences are used from the very first stan- 
dard lesson, because of the sense of 
achievement that this gives to students. 
The sentences are, of necessity, limited in 



their intellectual content, but the pattern of 
the finger reaches required enables stu- 
dents to unwittingly establish the correct 
movements. 

Meaningful practice is known to facilitate 
learning and spaced practice is generally 
more beneficial than massed practice, as 
interest and enthusiasm are maintained 
and fatigue avoided. Nevertheless, it has 
also been shown that practice sessions 
must be both regular and frequent. 

If, as teachers, we know there are common 
error patterns, we are bound to try to elimi- 
nate them. 

Because it was common for students to 
confuse E with I and D with K, for example, 
a conscious effort was made in the program 
to establish one key before introducing the 
key struck with the same finger on the other 
hand. E is introduced early in the program 
because it is the most common letter in the 
English alphabet and is often miskeyed. I is 
the key in the same position on the other 
side of the keyboard. In this program theD- 
E finger reach is established before the K-I 
finger reach. 

While the program adopts what the Ameri- 
cans call the 'skiparound' method of intro- 
ducing the keyboard, it was felt that there 
was value in establishing thebaseline of the 
guide keys (sometimes referred to as the 
'home keys'). The value of establishing this 
base in the first lesson is seen as more 
important than possible problems associ- 
ated with, for example, miskeying D for K. 
The construction of the sentences ad- 
dresses this issue. 

Preliminary results 

In 1987 the new program was the first soft- 
ware encountered by 270businessstudents 
in the Introduction to Computing unit at 
the South Australian College of Advanced 
Education. Their first 75 — minute work- 
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shop showed them how to switch on the 
computers, start the program, select les- 
sons, quit from the program and sw* tch off 
the computer. An average student covered 
the first 6 or 7 lessons during this work- 
shop. 

Students were encouraged to complete all 
the lessons within the following two weeks 
in their own time; no further contact time 
was devoled to keyboard skills. The pro- 
gram was readily accessible for 75 hours 
each week, stored on the hard disks of 40 
micro computers. Although it was up to 
the individuals to progress through the 
program at their own rate, they were ad- 
vised to try to have one or two short ses- 
sions (15-30 minutes, 2-4 lessons) each day. 

A few weeks later 197 of the students re- 
sponded to a brief questionnaire. 33% of 
these had previous keyboarding experi- 
ence and 36% admitted to spending less 
than two hours with the program after the 
initial workshop. The remaining 31 % were 
considered to have made a significant at- 
tempt to use the program to gain keyboard- 
ing fluency. 

No attempt was made to measure their 
typing speed objectively, but all those us- 
ing the program believed they could type at 
least 10 words per minute and almost half 
felt that they could type more quickly than 
they could write legibly. Casual observa- 
tion later in the semester showed that the 
majority of these students tended to use all 
v^r most) fingers, whereas the majority of 
the computer programming students in 
previous years used only one or two fin- 
gers. 

Although these results are largely anecdo- 
tal, they have encouraged the authors to 
continue with the program in 1988 and 
monitor the students' performance more 
objectively. Other institutions or individu- 
als wishing to use the program may obtain 
it from the authors on payment of a nomi- 
nal licence charge. 



Conclusion 

It is because of the overwhelming weight of 
evidence in favour of 'touch keying' that 
we require our students to work through 
the program described in this paper. We do 
not want to be accused of allowing them to 
become cripples - people whose thoughts 
cannot be expressed fully or effectively 
because they are inhibited by their lack of 
keyboard fluency. 

This computer program appears to meet 
our requirements of enabling all students 
to acquire modest keyboard skills without 
infringing significantly on contact time 
needed for other topics. 

Griffin and Keogh (1981) show that student 
perception of demands in movement situ- 
ations may well be the key to understand- 
ing students' movement confidence, since 
individual perception will determine how 
personally important and useful participa- 
tion becomes. Movement confidence is 
particularly important for itandicapped 
students who attempt to achieve effective 
movement behaviour in spite of movement 
inefficiencies related to their handicapping 
conditions. 

Are we not culpable, if we allow our stu- 
dents to become functionally handicapped 
because we do not enable them to perceive 
the value of touch-keying? 
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Development of CBT using AUTHOR 



Tony McSherry, 

Director, Microcraft Pty Ltd 



The history and evolution of the AUTHOR 
authoring system, design considerations and 
decisions. The creation of simple lessons and 
tests is described and demonstrated with par- 
ticular emphasis on the system's word proces- 
sor, graphic design system and animation 
package. 

The state of CBT today 

Some educators believe that the field of 
Computer Assisted Instruction (CAI) is 
well documented, successful and subject to 
immutable laws. In fact, the field is in its 
infancy and its short history is strewn with 
expensive failures. While some experts try 
to create a strait-jacket by interweaving 
Learning Theory and Instructional Design, 
I believe that there is still a large amount of 
trail and error experimentation and data 
collection to be done before any Grand 
Design will become apparent. The volatil- 
ity of the field is also enhanced by the 
constant introduction of new hardware. 

AUTHOR provides the subject expert with 
the ability to directly produce CAI and 
allows educators to put their theories into 
practice. 

AUTHOR 

AUTHOR is an authoring system. Its task 
is to allow subject experts and educational 
specialists to develop, present and manage 
Computer Assisted Instruction. Note that 
I have not mentioned computer experts, 
programmers and system analysts. AU- 
THOR was specifically designed to be used 



by the author(s) of CAI and not require 
computer expertise. Of course, this does 
not mean that AUTHOR users are com- 
puter illiterates, most of us now use word 
processors without being able to program 
and a certain amount of learning is neces- 
sary for effective use the system. I should 
also be careful not to alienate the computer 
experts who will wish to use AUTHOR - 
rest assured that AUTHOR supports a 
powerful procedural language with a vari- 
ety of commands to allow programmers to 
exploit all the power of the system. 

The evolution of AUTHOR 

AUTHOR sprang from very mundane 
roots. The precursor to AUTHOR was a 
limited parser that recognized 3 question 
types, presented them to students and re- 
corded results. Tests were written using 
the system text editor (remember line edi- 
tors?) and results could be examined and 
sorted in a few limited ways. Nevertheless, 
this was a major step up from my previous 
involvement with CAI - developing tests 
using a general programming language, 
specifically BASIC-PLUS on a PDP-11 
minicomputer. Nor were the tests them- 
selves at the edge of theoretical knowledge 
- they were simple tests for motor mechanic 
apprentices. In retrospect, this type of test 
site was a blessing. We had no Computer 
Science, Engineering or Business studies 
departments to effectively monopolize 
hardware and Computer Centre staff. The 
student interface had to be simple and 
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robust to deal with the average apprentice 
who was likely to have no experience of 
computers at all. 

At this stage Microcraft had produced 
some stand-alone educational software for 
CP/M microcomputers and Data General 
minicomputers. Looking for a new project 
wediscussed two possibilities, a wine data- 
base for the discerning connoisseur and a 
generalized authoring system for the 
teacher. We decided to go ahead with 
AUTHOR. 

At that time I was working in the Computer 
Centre at Richmond TAPE. Microcraft 
agreed to provide the software free to the 
college in exchange for a large test site, 

AUTHOR went through five versions at 
Richmond TAFE before Version 6 was re- 
leased commercially for the IBM PC. Ver- 
sion 6 supported 5 question types and col- 
our graphics yet required an external text 
editor and graphics package for lesson 
creation. Limited student management 
and results reporting were provided. 

Version 7 was released in late 1984 and 
incorporated a text editor and graphics 
design system and also some advanced 
features such as videodisc and speech syn- 
thesizer support. Version 8 (late 1986) 
extended what had become the AUTHOR 
procedural language and featured a com- 
pletely redesigned user interface that had 
both function key and/or pull down 
menus. Animation and networking were 
added and the ability to use all the colour 
graphics and text modes of the IBM FC. I 
will not enumerate all the additions that 
occurred over the years but simply refer 
you to our 750 page manual. I hasten to add 
that the tutorial section of the manual is a 
lot more digestible at around 80 pages. 

Lesson development 

Using AUTHOR is better demonstrated 
than described but I will attempt to cover 
the basic method. 



1. Plan the lesson or test using the built-in 
word processor. 

2. Use the other editors in the system to 
create required graphicsand/or anima- 
tions or recorded playback of external 
software. 

3. Expand your p T n into the lesson using 
the appropriate commands and ques- 
tion types. 

4. Test the lesson to see how it will appear 
to the student. 

5. Repeat steps 3 and 4 until you are satis- 
fied with the result. 

6. Enter the name of the lesson and a short 
description into the Lesson register. It 
may now be run by students. 

To alter or update a lesson 

1. Call up the word processor make any 
alterations and test the lesson. 

2. Use the other editors to change graphics 
or animations. 

AUTHOR Language 

The format of an AUTHOR lesson is quite 
simple. Any text that is not a command or 
a comment will be presented to the student. 
Questions are restricted to 8 distinct types 
that each have their own format. Various 
commands may be used to extensively 
customize the lesson. Branching is usually 
performed using IF.. THEN.. ELSE state- 
ments but simple branching between les- 
sons and randomization may also be used. 

The AUTHOR language currently has over 
80 commands. Each command must be 
preceded by a backslash (\). This makes 
commands easy to distinguish from text in 
the lesson and also makes the parser's job 
(and the programming) much easier. The 
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structure may become clearer with the fol- 
lowing example 

A multiple choice question which will 
provide feedback if answered incorrectly 
and then loop until the correct answer is 
given. 

VANSWERS 
\Beginning: 
\MULTDPLE 
4,1,C 

If you specify a command in an AUTHOR 
lesson but omit the backslash (\) AUTHOR 
will 

a. Give up 

b. Act on the command 

c. Place the command on the screen as text 

d. Crash the system 



\IF WRONG THEN 

I'm afraid not! If you omit the backslash the 
command will be treated as text and dis- 
played on the screen. 

\WAIT 

\GOTO Beginning 

\ENDIF 

Explanation 

The first few lines are comments and will be 
ignored by AUTHOR. Comments begin 
with a single quote. 

The first command (VANSWERS) turns 
off the automatic display of the correct 
answer. The next (\Beginning:) is simply a 
label that marks this point in the lesson. 

Next a multiple choice question is specified 
(\MULTIPLE). The next line specifies 4 
choices and 1 answer required of the stu- 
dent, the answer C. You may, of course, 
have multiple answers. 

44 8 



The question text is finished with a row of 
underlines called an End Line within the 
AUTHOR system. The End Line is used by 
a number of AUTHOR commands to de- 
lineate the end of variable amounts of infor- 
mation. 

Feedback is given to the student for incor- 
rectly answering the question using a mul- 
tiple line \IF.. THEN statement. Within 
this block, text is specified to be displayed 
on the screen and the lesson will WAIT 
until a key is pressed. The lesson will then 
return to the Beginning label (\GOTO) and 
ask the question again. This process will 
repeat until the correct answer is given. 

When we were designing the language we 
did go through some mental torment as to 
whether to include a \GOTO statement. 
However, although we fully support the 
concept of structured programming we 
found that the simple GOTO was more 
understandable than the other structures of 
procedures and \WHILE... \WENT loops. 
In the final analysis we were more inter- 
ested in subject experts quickly producing 
effective CAI than producing structured 
programmers - even at the risk that the 
structure of some lessons might resemble 
spaghetti. 

Resources 

Graphics, animations and colour text 
screens are considered to be resouces 
within the AUTHOR system and as such 
are distinct from the lesson. This allows 
different lessons to use the same material 
without wasteful duplication. These re- 
sources are created using the appropriate 
editors. 

The graphic editor has all the features of the 
common PC paint programs and is most 
effective when used with a mouse, how- 
ever all functions may also be used from the 
keyboard. The editor currently supports 
all CGA and EGA graphic resolutions and 
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the new VGA 256 colour mode will be 
released in early 1988. 

The animation editor allows you to ani- 
mate up to 4 objects on the screen at once 
with internal animation of each object. 

Design considerations and decisions 

• An integrated approach vs stand-alone 
lessons 

An authoring system should be integrated 
with built-in management of students and 
results. 

A number of authoring systems are similar 
to general language compilers - i.e. they 
produce stand — alone lessons that may be 
distributed. This approach means that les- 
sons cannot be altered and usually exist on 
floppy disk. The process of integrating 
these lessons into an easy to use structure is 
generally left to the user. This is beneficial 
to the creators of the lesson but not very 
useful for educators. AUTHOR provides a 
standard user interface and management 
of students, lessons and results. Other 
software may also be defined as lessons 
within the system and accessed in the same 
way as AUTHOR lessons. 

• Interactive lessons vs production of 
printed tests 

In the early 7(Ys hardware was expensive 
(especially colour graphics hardware) and 
a number of systems concentrated on pro- 
ducing printed tests for students which 
could be subsequently corrected when the 
studeni returned to enter his answers into 
the system. These systems emphasized 
statistics and had little interactivity. AU- 
THOR is more concerned with education 
than testing. 

• Use of standard hardware 

We deliberately chose IBM PC compatibil- 
ity because it was obvious, even at an early 



stage, that it would become the default 
standard for hardware and software. 
Education and training departments have 
never been endowed with large budgets so 
specialized hardware and expensive soft- 
ware could only appeal to a limited number 
of people. We did however, require a col- 
our graphics adapter and monitor as we 
believe them to be essential to the process of 
CAI. AUTHOR does support more expen- 
sive peripherals such as videodisc players 
and video digitizers, but effective lessons 
can still be written without the aid of these 
devices. 

• Use of the function keys and/or pull 
down menu 

Functions within the various editors 
should be rationalised and assigned to 
common keys. Users should have a choice 
of interfaces including use of the function 
keys with the aid of a template and a mouse 
or keyboard driven point-and-choose 
menu system. The interface should not 
clutter the user's work area. Novice users 
and those with mice tend to prefer to use 
the pull down menu. The menu can be 
called at any stage. As soon as the user 
selects the required function the menu dis- 
appears from the work area. Use of the 
menu is slightly slower than use of direct 
keystrokes, especially when the user 
knows the keystrokes without reference to 
the template. This mode is preferred by 
experienced users. 

• Independence of the user 

The system should be directly used by the 
subject expert with no need for computer 
experts. 

Great care was taken to ensure that lesson 
and resource creation was straight forward 
and that the system could be used at a 
simple or complex level. 

• Graphic creation 

Graphics should be drawn rather than 
programmed. 
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The use of rubber band functions and stan- 
dard graphic shapes such as circles, boxes, 
ellipses and lines meant that graphic crea- 
tion is interactive, fast and possible for 
those who feel they lack drawing skills. 

• Networking and remote delivery 

The system should be able to be networked 
and make remote delivery of lessons pos- 
sible. 

AUTHOR will use any network which 
operates under DOS 3.+ allowing central 
storage of student records and lessons. 
Any workstation on the network may also 
be used for authoring by instructors with 
password access. 

Remote delivery of lessons is possible in 
two ways. Standard AUTHOR lessons 
may be sent on floppy disk or via the .tele- 
phone system for use with a remote AU- 
THOR system. Alternatively lessons may 
be distributed independently of the AU- 
THOR system using the Lesson System. 
This system is available to commercial 
developers. 

Conclusion 

AUTHOR is currently used in over 140 
organizations across Australia and over- 
seas. T 'ganizations range from univer- 
sities a >llege* to banks and insurance 
companies. The people using the system 
have a variety of backgrounds and many 
have limited experience in using comput- 
ers. All have used AUTHOR to create 
effective Computer Assisted Instruction. 



Tony McSherry, is one of the directors 
of AUTHOR, Computer Manager at 
Richmond College of TAFE and co- 
creator of AUTHOR. Tony has been 
working in the area of CAL for ap- 
proximately eight years. He is also 
qualified and experienced in the fields 
of psychology, literature, media stud- 
ies and video production. 
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Diverse CBT Applications using AUTHOR 



John D. Rundle, 
Director Microcraft Pty Ltd 



The AUTHOR user community has responded 
enthusiastically to AUTHOR'S flexibility. Five 
specific lessons are to be demonstrated as devel- 
oped by AUTHOR users. AUTHOR is used in a 
wide variety of subject areas. 

When we originally designed AUTHOR, our 
main design criteria were to maximise flexibil- 
ity and user control of lesson presentation. Our 
users have responded enthusiastically to this 
flexibility and have outstripped us in discover- 
ing innovative ways to use AUTHOR. When 
they have been unable to achieve specific goals, 
we have been badgered into further developing 
AUTHOR, making it even more flexible. 

As part of our contact with our user com- 
munity, weoften view lessons or presenta- 
tions developed with AUTHOR. Our users 
have provided us with some excellent ideas 
and suggestions, some of which are beyond 
the capability of computers today, but 
which we will implement when suitable 
hardware becomes available. 

The Applications 

Today, I would like to show you five les- 
sons selected from a wide range of avail- 
able subject areas to illustrate AUTHOR'S 
versatility. 

I must stress that these lessons have been 
developed by our users and while I might 
suggest ways to improve them, I am pre- 
senting them as they have been developed. 

None of the developers do not have any 
special training in CBT, but they are experts 
in their own subject areas. 
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The lessons are in everyday use, and have 
been developed without help from com- 
puter specialists, and in most cases without 
attending specific courses in the use of 
AUTHOR. 

I would also like to thank the authors for 
giving me permission to demonstrate the 
following lessons. 

• Basic Electrical Circui ts. Developed by: 
Mavis Bird at Richmond College of 
TAFE. This lesson provides trainee 
auto electricians with an introduction 
to electrical circuits. 

• Sheep Dentition. Developed by: John 
Kent at the Melbourne College of Tex- 
tiles. A lesson covering sheep dentition 
as related lo wool types and the age of 
sheep. 

® Key Facts, A series of lessons on Diabe- 
tes. Developed by: Dr Matt Cohpn, 
Director of the Lions International Dia- 
betes Institute Education in self-man- 
agement for diabetics. 

• Chemistry Familiarisation. Developed 
by: J A Robinson and S Kobot of 
Queensland Institute of Technology. 
Familiarisation of students with AU- 
THOR and CBT. 

• Basic Indonesian. Developed by: Jo 
Fischer, Sacred Heart College, Ballarat. 
An introduction to basic Indonesian 
vocabulary. 
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The Demonstration 

I will work through parts of the five lessons 
as a student, making some deliberate mis- 
takes (and some not so deliberate) so that 
you can see the lessons as the students see 
them. 

I will also comment on specific features, 
plus ways of presenting information and 
asking questions. 

Conclusion 

Some of the major subject areas covered by 
AUTHOR users include the following: 

Accountancy 

Banking 

Chemistiy 

Computer Studies 

Computer Training 

Diabetes 

Drawing 

Electronics 

Engineering 

Internal medicine 

Insurance 

Languages 

Law 

Library and information 

science 

Mathematics 

Physics 

Scierco 

Wool classing 

AUTHOR lessons are easily updated and 
modified and may be transported to any 
AUTHOR system. Lessons may be sold, 
exchanged or donated at the author's dis- 
cretion. 

Microcraft Pty Ltd publishes the "AU- 
THOR Directoiy: A guide to AUTHOR 
users and lessons" based on results of sur- 
veys of our users. Please contact us if you 
would like a copy. 



Using Computers Intelligently 

Our approach, embodied in AUTHOR, is 
that the subject experts can develop CBT if 
given the right tool. 



John D. Rundle is one of the directors 
of Microcraft Pty Ltd, and co-creator 
of AUTHOR. John's previous experi- 
ence includes working for Norwich 
Life Insurance (PC Coordinator), BHP 
(Information Systems Training Offi- 
cer) and the Victorian Education De- 
partment (Maths and Computer Stud- 
ies teacher). John is particularly inter- 
ested in the application of PC's in 
providing solutions under the direct 
control of the user. 
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The Advanced Features of AUT !OR 



Uz McArthur 

Director, Microcraft Pty Ltd 



The use of videodisc, robots, gr_ phics and 
speech 1 >roduction with AUTHOR vrill be 
d scribed and demonstrated 



Videodisc 

Videodisc technology allows fast, direct 
access to video and audio information. 
This makes it very suitable for use with 
microcomputers for computer based train- 
It complements the use of the com- 
I 2r by offering high quality sound and 
speech and "real-lif e" images,bo th still and 
moving. The videodisc may also be used to 
hold over 50,000 still frames making it ideal 
for picture and graphics storage. 

Practical application 

Until recently videodisc technology has 
primarily been used by large organisations 
such as IBM and GMH which could justify 
the high cost of production, firstly to create 
a master and the.i duplication of the vide- 
odiscs. 

However, smaller organisations can make 
cost effective use of videodisc technology 
by re-authoring existing videodiscs to suit 
their needs. 

AUTHOR offers specific support for the 
Picneer LD-V4200 a:id can be used with 
any player which can be controlled via the 
computer's serial port. This means that any 
CA V (Constant Angular Velocity) disc may 
be used as a source of still frames and 
motion picture sequences for several les- 
sons. 



Using videodisc with AUTHOR 

The \ VIDEO command is used in the les- 
son whenever access to the videodisc is 
required. This is followed by the com- 
mands used by the specific player. For 
example, the following command for an 
LD-V4200 player will cause the player to 
search for frame 5000 and then stop. 

\VIDEO 
FR5000SE 



Menus to the video material may be cre- 
ated, questions may be asked and se- 
quences reviewed if the student answers a 
question incorrectly. For example, if the 
student answers the following question 
incorrectly the section of the videodisc 
which deals with this topic is played. 

YmUE/FALSE 
T 

An adequate fuel supply is one factor that 
contribuies to efficient combustion. 



\IF WRONG THEN 



Unfortunately you are wrong. Striiceakey 
to review efficient combustion. 

\WAIT 
WIDEO 
FR25443SE 
26080PL 
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Some features: 
• Customisation 

The \DEHNE VIDEO command is used to 
assign the functions of a particular player 
toany of the function keyson the keyboard. 
For example the following command as- 
signs the play function to the F4 key, still 
frame reverse to F5, still frame forward to 
F6, fast speed reverse to F7 and fast speed 
forward to F8. 

\DEFINE VIDEO 

F4=PL 

F5=SR 

F6=SF 

F7=:180SPMR 
F8=180SPMF 



• Text overlay 

Text may be overlayed on the video image 
using AUTHOR if your player (e.g. t,d_ 
V4200) has this facility. Text overlay may 
be used to create titles, arrows and other 
markers to point out areas of interest and 
display menus. 

• Direct student control 

The student may be given direct control of 
the player from the keyboard by including 
the \KEYS command in your lesson. You 
may choose to provide a\e student with a 
table of contents on the AUTHOR screen - 
listing frame numbers with subjects, al- 
lowing them to view sections at their own 
pace and analyse some parts in detail. 
Functions include: 

Play 
Reverse 

Still frame forwf^d 

Still frame reverse 

Fast forward and reverse 

Frame forward and reverse 

Scan 

how frame numbers 
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The combination of microcomputer and 
videodisc offers a powerful educational 
tool. Its use is currently restricted by the 
cost of production of videodisc material, 
however, the material already produced 
can be used in a variety of ways. Two recent 
developments in the field suggest that the 
use of videodiscs may increase dramati- 
cally over the next few years. These are the 
ability to store an hour of video material on 
a Compact Disc and the demonstration of 
different systems for producing erasable 
videodiscs. 

Robots 

AUTHOR lessons may incorporate the 
control of external devices such as robots 
for industrial training. Devices may be 
controlled through the RS-232 serial port 
from an AUTHOR lesson using the \PORT 
and \TALK commands. 

The \PORT command is used to set up the 
protocol between the rc bot and computer. 
The \TALK command \s used to send the 
robots control language. 

Example: controlling the SIR1 robot 

\TALK 
M 0,200 



This^miiand will move the robots shoul- 
der from position 0 to position 200. 

Graphics 

AUTHOR supports a range of graphic 
screens and special effect screen wipes, for 
changes between screens. Graphics may be 
simply displayed, overlayed with ques- 
tions or text or presented as a series of 
slides. The following modes of graphic 
screens are available: 

Text character graphics (created with CED, 
the Colour Text editor) 
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40 X 25 character 16 colour CGA or 
EGA 

80 X 25 character 16 colour CGA or 

EGA 

Pixel based graphics (created with GED, 
the Graphic editor) 



4 colour CGA or 

2 colour CGA or 



320X200 pixel 
EGA 

640 X 200 pixel 
EGA 

640 X 200 pixel 16 colour EGA 

640 X 350 pixel 16 colour EGA 

Special effects 

Special effects are used to add interest and 
continuity to the graphics being displayed 
and to create the impression of animation. 

Twenty four special effects may be used 
with GED screens ranging from vertical or 
horizontal wipes to a dissolve. The 1 speed 
of the effect can be controlled. 

Fx Description 

0 Instant load to screen 

1 Wipe from top to bottom 

2 Wipe from bottom to top 

3 Wipe from left to right 

4 Wipe from right to left 

5 Crush from top & bottom 

6 Crush from left & right 

7 Expand to top & bottom 

8 Expand to left & right 

9 Crush 

10 Expand 

11-20 As in 0-10, but with edges 

21 Fade 

22 Interleave from left & right 

23 Diagonal wipe from bottom, lef t 

24 Diagonal wipe from bottom.right 

Video Digitisation using the PC—EYE card. 

Video digitisation is the process of convert- 
ing visual images to digital iformation. 
The sophistication of a digitiser is ex- 
pressed in the number of dots or pixels it 



can resolve and the number of shades of 
grey it provides - grey scales. The more 
grey scales the more life-like the image will 
appear. 

• Using the PC-EYE 

The image may be captured using a stan- 
dard camera for input to the graphics edi- 
tor. The displayed examples use only 4 
grey scales at a resolution of 640 x 350 
pixels. A video digitiser can savea substan- 
tial amount of time in creation of graphics. 

• Practical application 

Best results are achieved with black and 
white line drawings. 

Voice Production 

There are two ways of creating speech - 
digitisation and synthesis. Speech digitisa- 
tion samples real speech and converts it to 
digital information. This gives high quality 
speech but requires a large amount of disk 
space for storage of the information. 
Speech synthesis builds up words from 
phonemes. 

• Using the VOTALKER IB speech synthe- 
sizer 

The VOTALKER comes with a standard set 
of words and the user can also build a set of 
words which may be modified using the 
phonetic editor. The rate of speech, ampli- 
tude, inflection and filter can be controlled. 

The WOTALKER command is used to 
send text to the speech synthesiser. 

For example. 

WOTALKER 
2 

HellfI-5] o. [i=0]This is the VOTALKER 
speech board. 
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The VOTALKERwillsaythissentence with 
an upward inflection on the o in Hello after 
an initial delay of 2 seconds. 

• Practical application 

Realistic speech can only be obtained by 
patient use of the phonetic editor. 

Conclusion 

AUTHOR may use a variety of perhipher- 
als as lesson resources. Any device that has 
anRS232serial port may be controlled from 
within an AUTHOR lesson. We are com- 
mitted to the continuing evolution of the 
AUTHOR system. As new devices which 
promise to enhance the learning process 
appear on the market, they * vill be incorpo- 
rated into the AUTHOR system. 



Liz McArthur, is one of the directors of 
Microcraf t and co-creator of AUTHOR. 
Liz is also qualified and experienced in 
the areas of psychology, history and 
philosophy of science, librarianship 
and production of audiovisual media. 
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ABSTRACT 

This paper investigates an approach to providing a general-purpose 
authoring/tutoring shell for intelligent computer assisted learning 
systems. The approach is to outline an object-oriented 
representation of task/goal hierarchies, then to consider the ways in 
which domain expertise, student information and teacher expertise 
can be made to interact with such hierarchies. The result is a 
skeleton in terms of which some exploratory lessons are being 
constructed; and in terms of which further research on the domain 
expert system, student modelling, educational expertise modelling, 
and user interfacing can more concretely be developed. 1 

Introduction 

Most current work on the construction of Intelligent Computer Assisted 
Learning (ICAL) systems has concentrated on one-topic systems: 
diagnosing faults in a particular electrical circuit - the SOPHIE system 
(Brown, Burton & DeKleer, 1981), solving the WUMPUS game 
(Goldstein, 1981), and ACE, which discusses the analysis of nuclear 
magnetic resonance spectra (Sleeman & Hendley, 1981). These systems 
and others like them were not intended as vehicles for widespread 
educational use; rather, they are vehicles for investigating and solving 
important research problems: natural-language communication, 
modelling the evolution of procedural knowledge in a learner, and 
dialogues to monitor and guide student reasoning, respectively. Those are 



l This research is supported by grants from the Apple Educational Foundation, 
Australian Telecommunications and Electronics Research Board, La T,obe University 
School of Mathematical and Information Sciences, and the Victorian Department of 
Industry, Technology and Resources. 
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problems that need solving first if we are to use artificial intelligence 
effectively in education. ° 

In the EXCALIBUR Project, by way of contrast, the authors and 
others are investigating what is involved in providing a general-purpose 
ICAL system, one which provides an authoring and knowledge 
engineering shell, analogously to a standard expert system shell, and a 
delivery system for students (Richards, 1986a)." Such a svstem is intended 
to be general-purpose in that the architecture and knowledge 
representation methods used should involve no specific assumptions about 
the content or nature of the subject domain to be taught, nor about the 
modes of learning or presentation (instructional, student-driven, 
exploratory, problem-oriented, etc) to be used. 

To use such a system, a person whom we will call the author will 
interact with the system to create what for lack of a less perjorative word 
we will call a tutorial — a program which can then be run bv a student 
with the aim of learning from his or her interaction with it. We stress that 
it is up to the author to decide the extent to which the student's interaction 
with the tutorial is to be constrained by (for instance) predetermined 
delivery sequence and student assessment results, in which case the author 
will need to specify instructional modes or rules to the system; or to 
which the student may treat the tutorial as an educational information kit 
and tool bag, m which case the author will need to specify what resources 
and modes of exploration are available to the student. The pomt is that a 
general-purpose ICAL system should place little constraint on the 
educational philosophy the author wishes to adopt. 

The question is: how might one build such a general-purpose 
system? The main problems we have identified, for which solutions must 
be found that do not compromise the sought-after generality, are: 

(a) How to store data on the subject domain of the tutorials, and 
how to perform analyses on that material in ways relevant to 
the learning process at hand (designing the Domain 
Information System facility, which in manv cases will 
amount to an Expert System or Knowledge'Based System); 

(b) How to construct a knowledge base about the student, 
including what the student believes and has learnt in the 
domain of the tutorial, and why and how. This facility is 
called the Student Model. 

fc) How ro incorporate rules about student knowledge and 

performance criteria that can be usea to tailor or guide the 
presentation of the student session m the iight of information 
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gathered about the student so far. This is the Mentor facility 
(Sussex, 1987). 

(d) How to unify these under a System Driver which handles 

authoring sessions as well as student sessions. 

The Domain Information System is not necossarily the same as the 
material which the student may learn. Often, it may be much more 
extensive, for the same reason as a teacher usually needs to know far more 
about a subject than s/he will teach, just in order to handle the teaching 
process well. In the case of an ICAL system, the Domain Information 
System may often need to contain intelligent subsystems enabling the 
computer to solve problems whose solution is needed for the tutorial 
interaction, but whose solution method is either far too advanced for the 
student or is a computer-oriented process that can be quite confusing to a 
human. Crudely put, machines and people do not think alike. Examples 
are: 

The parsing of a given French sentence in a French grammar 
tutorial, in order to generate the specific grammatical and 
pragmatic information the student needs for the interaction about 
that sentence. Machine parsing methods are usually totally 
different from those used in a French language tutorial class, even 
if the end-products (parts of speech, agreement relations, etc.) are 
much the same. 

The checking or production of a proof step in the derivation of a 
proof in a tutorial on mathematics or formal logic. A student may, 
for example, be learning one particular method of doing formal * 
logic, such as natural deduction; yet the tutorial system will use a 
pattern-matching procedure which is not in the least educationally 
relevant, to check the student's proof steps. 

We cannot easily do without the special expertise of the Domain 
Information System. If we did away with the French parser, then an 
author could provide the parsing information needed by the student for 
each stored sentence; but then that information could not be generalized 
to cover sentences typed in by the student. In the logic example things are 
worse, for proof checking information cannot in principle be provided by 
the author for non-trivial derivations there can be an infinity of correct' 
next steps". Only a special proof-checking procedure will do the job. 

We turn now from considerations about the material to be learned 
to questions of how to learn it. In French grammar, loaic. and indeed 
courses on most topics there may be manv modes of learninc-. The student 
might be, for example: 
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Working through a set system-controlled sequence of actions, 

'.•'reely exploring an environment containing knowledge and 
techniques relevant to the subject domain, 

Trying to devise his/her own techniques for reaching a °oal and 
testing them. = 

The more of such learning modes as these that are made available to the 
student, the more demands are put onto the content and problem solvin* 
power of the underlying Domain Information System. But even more* 
stress can be put onto the other three facilities, the Student Model the 
Mentor, and the System Driver. 

In the rest of this paper we will look at a method of desbnin° and 
unifying these four facilities. The result is the specification of an ° 
architecture for a general-purpose ICAL system. 



Goal/Task hierarchies 

One place to start in trying to analyze this problem is the idea oiGoallTask 
hierarchies. See Figure 1. 



A tree-structured Goal/Task hierarchy has at its root the overall *oal of 
the current tutorial, and the (immediate) dependants of any node are the 
subgoals that need to be achieved in order to achieve the node's own *oal 
On each node is a task, which to be carried out requires that the the tasks' 
on the dependant nodes have been executed. The terminals of the tree are 
initial goals which have no prior goal: tasks which can be executed 
without performing prior tasks. Formally, the links from a node N to its 
dependan' nodes N h N 2 , ... mean that the tasks on the dependants are 
individually necessary and jomtly sufficient for the execution of the task 
on N; so a task hierarchy is an and-tree. and a link from N to a dependant 
node Nj means that achieving the goal on Nj is a necessary condition of 
achieving that on N. That is to say, in order to achieve the 20a! on N it is 
(logically, pedagogical!)', epistemically, or ...) necessary ^achieve or to 
have achieved, the goals on N,, N 2 ....; and when they have been achieved 
it is (logically, pedagogically. ...) possible to achieve the goal on N by 
doug the task on N. The relation between the goal and the task on a node 
is simply that the goal is what has been achieved when that task has been 
executed, given that the subgoals on Nj, N 2 . ... have been achieved. Any 
tighter definition of the linkage relation m a goal/task hierarchy is not ' 
really a matter for the system designer, but for the author of a tutorial. 
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who will wish to exploit it as a control structure that may be adapted to his 
or her ideas aoout the flow of the tutorial. 

In Figure 2 we have a small example of a Goal/Task hierarchy for 
detecting subject-verb agreement in number, which illustrates the points 
just made. v 



The knowledge needed to determine agreement of subject and verb (the 
goal on N) is the gender and number of the subject (left-hand sub-°oal) 
and the gender and number of the verb (other sub-goal). When they are 
known, a comparison of them to see if they are the same (task on N) 
suffices to reach the goal on N. 

Suppose now a student is attempting to use an ICAL program based 
on this Goal/Task hierarchy to learn about subject-verb agreement. We 
imagine that the student is presented with a series of examples - Fn-nch 
sentences that may or may not obey the rules about agreement - auJ is 
required to move through the hierarchy with each example. (The 
pedagogical effectiveness of this approach is not up for discussion at 
present: we simply need an example to motivate this description of our 
system.) Then on each node we need to record a method of determining if 
the student is correct in his/her task solution. One way to do this might be 
to look up the answer as entered by the tutorial author on a record 
containing the current sentence example (SI of Figure 3 is a record 
containing the needed data).. More intelligently, such a frame might be 
created by a parse procedure belonging tc the underlying Domain 
Information System (Figure 4). 

Figure 3 contains (sketchily) three types of control (or. if you 
prefer, information). v y 

1 ) Domain information, as in the record S 1 . 

2) ^ U j torial dnvin = P roced ures, as m the StudentTest slot of 

3) Student modelling services, as in the StudentRecord slot of 
the frame Nl. 

Each of these three control regimes mav embodv a °reat deal of 
information, procedures, and the like: but as Figured su««ests each 
regime mtersects with a Goal/Task record, such as Nl. in a° simple wav 
The architectural design of the system is based on this, brings us to the 
central design issues of the system. 
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Object hierarchies and Type-systems 

In Object-Oriented Programming Languages (OOPL's: see Byte, 1986; 
OOPSLA, 1986) the entiiy that does die work is not a procedure, as in 
procedural languages, but an Object (with a capital O to avoid ambi<niity) 
containing local data (like Pascal records) and procedures (called ° 
Methods), which are accessed and activated by Message? (like command 
lines) sent by one Object to another, and returning values. Objects are 
similar to the sets and individuals of set theory, in that one Object can be a 
member (usually called an instance) of other Objects; or it can be a subset 
(subtype) of other Objects. For instance, an Object containing 
information about the behaviour of the French verb voir wilf be an 
instance of another Object containing generic information about the 
behaviour of transitive verbs. That Object in turn will be a subtype of 
another Object containing generic information about the behaviour of 
verbs in general. Note the difference between an instance and a subtype- 
voir is an instance of a transitive verb, and of a verb. It is not a subtype of 
either. And a transitive verbs, as a type, are not an instance of verbs, they 
are a type of verb. 

Subtype relations form a hierarchy (see Figure 5), with instances as 
the terminal nodes of the hierarchy tree. 



Objects m the tree normally inherit properties belonging to any higher 
Object; for instance if Verb in Figure 5 recorded that all verbs have 
subjects, that would hold of transitive verbs and intransitive verbs and all 
instances etre and voir as well. So if a queiy were addressed to this ire- 
Do transitive verbs take subjects?' 'he TransitiveVerb Object would 
receive this query message and answer 'Yes.' If the lesson desi<mer 
wished to treat the "erb etre as an exception to the rule about subjects 
s/he records on the Etre object that it does not take a subject, and the 
inheritance of the contradictory property from Verb is blocked. The 
query 'Does etre take a subject?' would so to the Etre Object which 
would directly answer 'No,' without consulting further up the hierarchy 
In the same way procedures can be stored on the appropriate Object, and 
get consulted by lower objects unless overriden bv a lower procedure 
The procedure for finding a verbs subject belongs on Verb, and the 
procedure for finding a verb's object belongs on TransitiveVerb. 

Objects that are instances typically record different sort of 
information from objects that are types. Instance Objects record 
information specific to the thing that Object represents, but a type Object 
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will record generic information true of all instances of that type. The 
type Object StudentModel would record the pass mark needed for any 
student to succeed in the current tutorial; but an instance of that type, such 
as Student36, would record that student's name and mark achieved. 

In our ICAL design, the Goal/Task hierarchies are not Object 
hierarchies as described above, even though the nodes (see Figure 2 and 
Nl of Figure 3) are Objects. So from now on we will call them Goal/Task 
Objects. The hierarchy shown in Figure 2 is plainly not one of 
inheritance, for Nl does not inherit anything from N. The link as 
remarked earlier, is that the lowerGoal/Task Object contains a goal that is 
a necessary condition for attaining that in the higher Object. A goal, 
filling a slot in a Goal/Task Object such as Nl, is however an instance of 
the type Object called Goal, which specifies the structure of any of its 
instances, which are of course individual goals. (See Figure 6.) 

Figure 6a shows a type Object called Goal containing a number of 
structured InstanceSlots, which describe generically the slots occurring 
on each token of this Object that may get created, i.e. on any individual 
goal Object Goal5 is a token of Goal; and what the Goal slot of Nl in 
Figure 3 really contains is a pointer to Goal5. To create GoalS. the 
InstanceSlots of Goal are called upon to define the structure of Goal5, and 
so is any Object of which Goal is a subtype - in this case Universe, which 
is the unique upper bound of the inheritance lattice. This is the method 
used to create any new Object. 

The OwnSlots contain data or Methods belonging to that Object 
itself; these slots are the ones defined by the corresponding generic 
Instance Slot data on the higher Objects. One Object can access the data in 
another Object's OwnSlots, or activate Methods stored there, by sending it 
a Message, containing arguments for the Methods parameters if needed. 
For example, since the Goal slot of a Goal/Task Object points to some 
instance of Goal, Goal/Task Objects are designed so that they can send 
messages to Goal. For example, the pointers to Goal/Task nodes making 
up the Goal/Task hierarchy (as seen in Figure 2) are determined by a 
Goal/Task Object sending a message to the instance of Goal that its Goal 
slot points to. In this way, a Message from Nl to its Goal instance G5, to 
find G5's supergoal, will return N's goal. Then a Message to that goal to 
report its subgoals will return G5 s "sibling subgoals" (j ust one > "^the 
example) which must also be achieved by the student before the goal of N 
can be attempted. Messages can now be sent from Nl to each of those 
subgoals, accessing the Goal/Task objects they belong to (just N2 ) and 
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checking which of them the student has already achieved. This helps to 
determine the flow of tutorial control. 

Where does the code for these messages reside? In OwnSlots in the 
type Objects Goal/Task and Goal, to be inherited by their instances. For 
example, the Method to find a Goal/Task Object's siblings resides on the 
type Object Goal/Task, and looks like this, in pseudocode: 

GetSiblings: 

supergoal := ask Goal for its supergoal Object; 
sib-goals := ask suDergoal for list of its subgoal Objects- 
siblings := collect into a list: 

for each sib in sib-goals: 

ask sib for its Goal/Task Object; 
return (siblings less self). 

Now if Nl is sent the message GetSiblings it will return the list (N2). 

This example of how a slot in an Object can point to another Object, 
which belongs to a particular hierarchy of Objects, illustrates an 
important aspect of the architecture of our design. We have identified a 
number of Object hierarchies, or clusters thereof, that are needed in our 
ICAL structure 2 . Major ones are: 

Goal type-systems, discussed in detail above. 

Task type-systems, defining activities for the student. 

A type-system to describe the Student Models for individual 
students and associated diagnostic procedures. 

Logic type-system to provide rule frameworks for a logic- 
programming reasoning service where needed. Sets ofthese 
rules comprise the Domain Expert System, reasoners about 
the student's belief base, and the analysers for a natural 
language interface. 

Object networks 

We remarked earlier that the hierarchy of Goal/Task Ot jects was not 
linked up by inheritance, so in present terminology it is not a tvpe-system. 
Type-systems are used to define Objects as types, subtypes, and ultimately 
instances, and to provide through inheritance powerful built-in reasoning 
services. But the hierarchy of Goal/Task Objects is effectively a simple ° 
semantic network: data nodes joined by labelled links. 

2 A type system here is a sublamce of the one overall Obiect lamce. and it has a smsie 
upper bound which is some very significant type Object such as Goal or Stuaent or" 
LogicRule. 
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Overall, the system we are designing can be viewed as comprising 
several connected semantic networks or conceptual graphs (Sowa, 1984), 
which we will call Object networks. Major Object networks in a tutorial 
program are: 

The underlying Domain Information System 

The Student Model facility 

The Mentor facility 

The System Driver 

The Goal/Task network 

Human/machine interfaces 

Natural language processor 

• Reasoning systems, primarily for the Domain Information 

System if it is knowledge-based, and for conducting rational 
dialogues with system users. 

Concentrating attention on these Object networks as the 
architectural framework of an ICAL system makes the type-systems 
disappear into the background. On the other hand, if you concentrate on 
the type-systems, then you see the Object networks as largely derivative 
structures, being created by the pointers in slots of the Objects as created, 
maintained, and manipulated by the type-systems. Look at how we found 
the siblings of a particular Goal/Task Object, which illustrates how the 
Goal type-system defined the Goal/Task Object network. 

Figure 7 tries to depict, on two-dimensional paper, the multi- 
dimensional structure of the resulting system. 



It would be better to visualise slots (in Target of Figure 7, for instancy 
not as containing pointers, but containing the Objects ported to, and to 
visualise each cype-system as lying m a different plai >r dimension. The 
Object networks cannot be entirely determined by the background type- 
systems and slot pointers; but to the extent that they are, the authoring 
task for a given tutorial is simplified and automated. The author is 
presented with ready-made prototypes for type-systems, e.g. the type 
Objects Goal/Task and Goal, and needs to specify instances and what goes 
into the OwnSlots of those instances. That can be more like a data-entry 
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task than a programming task. To the extent that Methods need to be 
developed by the author of a tutorial, typically in an intelligent Domain 
Information System, then to that extent programming or knowledge 
engineering is needed. 

At its simplest, then, the tutorial construction procedure for an 
author is: 

Construct a Goal/Task network for the tutorial domain. 

• Construct a Domain Information System which will provide 
the domain data and processing that a student (or the system) 
may need at each nodi of the Goal/Task network. 

From the point of view of the system designer, who has to think 
about how to make die authoring process simple yet powerful, three 
important research goals that we are exploring are: 

• To devise skeleton Goal/Task node objects that put few 
constraints on the type, content, or style of tutorial to be 
developed around those tasks, yet which allow the author to 
express the cognitive structure of the tutorial with a 
minimum of special programming or modification. 

• To provide a clean interface to the Domain Information 
System that allows domain information to be entered 
securely; and in a way that permits reasoning on that 
information and creates suitable output for student users. 

• To develop an author/system interface that requires as little 
learning as possible by authors, while giving them as much 
power and control as possible over the system and the 
tutorial they are creating. To do this very high-level editors 
and browsers are needed, such as network displays and 
network editors. 

To illustrate the problem of designing authoring facilities for a 
general-purpose ICAL, and the way in which an Object-based 
architecture helps, we will now look at the question of providing various 
tutoring strategies or methods for any given tutorial material. 

Provision of Tutorial Strategies 

The object-oriented approach allows several useful feamres and 
procedures to be developed, virtually free, as aspects of the OOPL 
methodology. 
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The Goal/Task hierarchy can be generalised to an and/or 
digraph, in the manner of the Feature Networks of (Webb, 
1986). 1.i"s now allows us to represent any structure of 
necessary and sufficient conditions between nodes, which 
give great freedom in representing the epistemological 
structure of the concepts, skills, etc. being tutored, 

DoFirst and (inversely) DoNext slots on a Goal/Task Object 
can contain pointers to other such Goa/Task Objects, thus 
controlling lesson sequencing in a rigid manner. 
Alternatively, the Goal/Task hierarchy can be used to 
provide default tutorial sequencing. If the type Object for 
these nodes has an instruction to do first the dependants of a 
node (if any), then a bottom-up tutorial regime is established 
as the default. Or, an instruction there to do the parent first 
establishes a top-down regime, allowing the student to avoid 
doing explicitly the subcasks of a task s/he can do in one hit. 

A TutorialStrategy slot on a Goal/Task Object can contam 
code for an explicit tutorial strategy, to override the contents 
of DoFirst and DoNext slots, but accessin^ them if needed 
typically under certain conditions laid down by the author or 
inferred from the student model. 

DoFirst and DoNext slots will in general create a pointer 
universe for the Goal/Task Objects that organizes them as a 
directed lattice or even a general digraph, with lower bounds 
and upper be nds representing the first and last things to do. 
This c^n be even more complicated if these slots contain 
disjunctions or conjunctions of pointers. A system-provided 
graph search algorithm will act as a tutorial planner for the 
student, finding feas ; Me paths to the root task/goal node(s). 

In general, a student will have some task to do at a Goal/Task 
node, even if it is only to read something. Slots on the node 
can specify different tasks for different tutorial strategies, or 
for different conditions that the student is in: slot? such as 
Remediate. CheckKno* ledge, TestKnowledge. TellStudent. 
Access to these will typically be determined by the 'ode on 
the TutorialStrategy slot. Thus, except in rather primitive 
lessons, the Goal/Task network need not of itself define any 
sort of sequencing of student tasks. 

The task(s) at a GoaLTask node can recursively be defined in 
terms of another "lower-lever Goal/Task hierarchy. 



i$7 

ERIC 



458 



Using Computers Intelligently 



effectively providing different levels of abstraction or detail 
at which a student might proceed with the tutorial. 

Costs can be statically or dynamically associated with nodes 
on the graph, reflecting difficulty of task, desirability of 
doing the task, etc. The graph-search algorithm mentioned 
above will then seek minimal-cost paths for the student. 

Any slot on a Goal/Task node can have a UserAccess? facet 
on it, indicating whether the user may access the information 
or execute the procedure in that slot. This provides a control 
over the openness of the tutorial material to the student, and 
the extent to which they c<L. browse, select their own 
learning method, etc. Such a facet may of course contain 
code, not just \es or No, determining the access conditions 
for that slot, and distinguishing between types of user, such 
as programmer, tutorial author, and student. 

Authoring a tutorial can be treated as one mode of use of the 
tutorial. This allows a student access to the authoring tools, 
and a high level of access to slots in the Goal/Task network, 
as well as to the Domain Information System and the Student 
Model system. This has the advantages of providing a 
uniform user interface, and not one for the author aH 
another for the student; and of opening up a powerfi 
learning-by-making tutorial strategy. The disadvanta. is 
that the student could damage or destroy the tutorial by 
his/her modifications; so a student-as-author access class 
needs to be distinguished from a true-author access class. 

Student Modelling 

Here too. the OOPL approach to system design allows a lot of student 
information to be collected and used more or less automatically. 

Demons on a Goal/Task node can collect any type of 
monitoring data on student behavior when the goal is visited. 
The data can then be dispatched to approbate nodes in a 
student-modelling structure. Demons on nodes in that 
structure can then update student statistical data, revise the 
profile of the student, and despatch information to the 
blackboard that will be needed for the next stages of user 
interaction 

Collected student data, either on a Goal/Task node or m the 
Student Model database or on the blackboard, can be accessed 
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by message-passing to help control the tutorial or to 
determine how to respond to the user. 

Overlay models of student beliefs (Goldstein, 198!) are 
effective^ generated automatically by storing student beliefs 
about r. Goal/Task node on that node, and similarly by 
storing student beliefs about some item or concept in the 
Domain Information System database on the Object encoding 
that concept This provides the raw data for analysing bugs 
in student beliefs (Stevens, Collins & Goldin. 1981), which 
are important in directing further tutorial interaction. 

Comparison with other systems 

The idea of Goal/Task nodes is found in a simplified form in the ECCLES 
system (Richards & Webb, 1985); although there they are arranged 
strictly in an or-tree whereas here any and-or graph is consmictible. The 
point of the or-tree was that a path through the tree represented an 
appropriate series of tasks for the student when faced with a particular 
problem in the domain. Analysis of the grammar of one type of French 
sentence, for example, would pfOu.*.u down one path, determined by die 
grammatical features of that type, and analysis of sentences of another 
type would proceed down a second path, taking alternatives appropriate to 
the different features of the second type. Each sentence to be analysed is 
flagged by a tip node in the decision tree, thus determining the path of 
tasks to take. See Figure 8. 

Also, in ECCLES. the actual tutorial interactions are determined by 
question-response material stored on each node. On the present model, 
many tutorial modes are possible, and a student is not constrained to any 
path through the Goal/Task network (though can be). Moreover, in the 
present system, if a student is "at" a particular Goal/Task node, the 
interaction there can be of many sons, and be determined by processes in 
the Student Model. Mentor, and Domain Information System, and as 
outlined in the previous section of this paper. Teaching material on a 
Goal/Task node generally just consists of pointers to the relevant objects 
in the Domain Information System, or. in more complex cases, messages 
to the Mentor who organizes appropriate material from the Domain 
Information System. It is important to realize that the Goa Task Objects 
in the present system are mainly there as points of intersection of Objects 
from many type-systems, thereby acting as nodes for an Object network 
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(the Goal/Task network) that describes epistemological relationships in 
the subject domain to be taught. 

The Goal/Task network provides a description of the operations 
that students must perform to complete learning tasks from a subject 
domain. Often this network will map directly onto the Domain 
Information Ssytem - the network that describes the knowledge that the 
student is to acquire through the performance of those tasks. For 
example, in Figure 2, Nj should map directly onto a node in the Domain 
Information System specifying that the number of the subject of a 
sentence must be singular or plural. No should map onto a similar node 
relating to verbs. Finally, N should map onto a Domain Information 
System node specifying that there is subject/verb number agreement in a 
phrase if and only if the number of the subject is the same as the number 
of the verb. 

A Goal/Task network will only map directly in this manner onto a 
Domain Information System network if each element of knowledge that 
the student is to learn is to be taught by a single operation that the student 
is to perform and if each operation in turn relates only to a single element 
of domain knowledge. There will be many domains for which these 
conditions do not hold. 

The idea of basing lessons on explicit descriptions of the knowledge 
to be taught has been explored through the DAB IS system (Webb, 1986). 
DAB IS utilises a form of and/or digraph, the feature network, to 
represent the epistemological structure of the domain to be taught. Thus. 
DAB IS lessons are based on ' plicit descriptions of the knowledge they 
arc to teach (the Domain Iniormation System) rather than on explicit 
descriptions of the teaching strategy that is to be pursued (the Goal/Task 
Hierarchy), as is the case with ECCLES. Figure 9 illustrates the 
difference. This allows DABIS to construct far better student models than 
ECCLES in domains for which there is not a one to one correspondence 
between the Goal/Task hierarchy and the epistemological structure of the 
domain. 



However. DABIS has the shortcoming that it is difficult to specify 
instructional flow that differs substantially from the structure of the 
Domain Information System. Thus, like ECCLES. and for the converse 
of the same reason. DABIS operates best in domains in which the 
Goal/Task hierarchy maps directly onto the Domain Information System. 
As a result, tutorials for both systems tend to be selected where these 
conditions hold. This, unfortunately, tends to obscure the fundamental 
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differences between the semantics of the underlying structures utilised by 
the two systems. However, as described in (Webb, 1986), these 
differences are both real and significant 

The present Project, EXCALIBUR, can be seen as unifying the 
ECCLES and DABIS approaches to allowing the explicit description of 
both a Goal/Task network and a Domain Information System within the 
one system. What EXCALIBUR adds to the other systems is: 

explicit Goal/Task networks (missing from DABIS), 

explicit knowledge structures (missing from ECCLES), 

the allowance that student paths through the Goal/Task 
network need not be constrained by the necessary-condition 
vectors of that network, but by pointers in DoFirst and 
NoNext slots in the Goal/Task Objects, 

the provision an Object-oriented architecture for the 
construction of ICAL's around the Goal/Task networks. 

The reason for treating the Domain Information System separately 
is just that in general a lot more information and reasoning ability is 
needed in a teacher than the curriculum they teach (see the Introduction, 
above.) However, the Domain Information System can, in the Object- 
structured architecture of the present system, be coupied as closely as 
needed with the Goairt ask network. In some cases it could be dispensed 
with entirely; as where the tutorial author provides the necessary parse 
data for the problem French sentences. 

Conclusion: further research 

The design of a suitable architecture is just the starting point of the 
EXCALIBUR Project. Current active research by the 
authors consists of: 

Building small tutorial systems along the above lines, as 
different in subject area and tutorial approach as possible, 
testbeds for the design of Goal/Task hierarchies and nodes, 
and of the various Object networks and their interaction 
(Richards, 1986b) 

Abstracting from those cases to an adequate common Object 
formalism. 

Other current EXCALIDUR work comprises: 

Design of Student Mc del systems that incorporate different 
theories of cognitive .trucrure and learning; with the aim of 
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using EXCALIBUR as empirical tests of those theories 
(dimming, 1986). The use of ICAL systems as testbeds for 
cognitive theories has been explored by (Anderson et al, 
1984). 

• The problem of incorporating current work on 

"Instructional Design" - the study of how to design good 
teaching vehicles and learning environments — into 
EXCALIBUR as features available by default or on the 
author's choice (Barrett, 1986). 

Natural language processing for the system (Sussex, 1987). 

User-computer discourse management, including answer 
negotiation, losic of dialogue, and modelling student beliefs 
(Girle, 1986.)* 
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A type Object for sentence data Note that SI 
or Figure 3 is an instance of this Object. 
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Figure 7 

Type-systems and Object networks 

Four type-systems arc shown, linked by plain lines showing 
inheritance. One Object, called Target, shows its slot pointers 
(thin arrows) to other Objects. Inheritance and slot pointeis 
(those for other Objects are not shown) allow Methods in Objects 
to determine the conceptual graph relations (heavy arrows) that 
define an Object system 
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(a) The type Object "Goal" (simplified): 

(b) An instance, GoalS, of Goal. 
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Par; of an ECCLES decision tree for ami) zing the Trench 
pass* comport construction Nodes show the information gained to reach 
Ihem: terminal nodes (rounded boxes) also show ihe path number to that node. 



Pronominal 




Yes, 



55 



Hours 9 
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